Staff Data Platform Engineer

About the RoleThe Data group at Dexterity is designing one of the most distributed data infrastructures on the planet. Our charter is to build a platform that connects the world’s warehouses, spanning from the edge devices to the cloud.With a growing number of robots deployed across the world, Dexterity’s robots collect terabytes of operational data at the edge which is used to improve our operations as well as that of our customers. Our data platform ingests raw robotic sensor data, video/ still image feeds, along with a variety of log data while handling considerations like low-bandwidth connections. We extensively utilize cutting edge collection and transformation tools to unlock the potential from our data. We are looking for talented engineers to shape and build the next generation of the data engineering pipelines to bridge the divide between edge and the cloud.As a Data Platform Lead, your responsibilities will include:Shape and build infrastructure that ingests sub-millisecond sensor data as well application logs generated on-premise and makes it available to cloud data consumers with real-time performanceDesign, implement, and optimize the performance of distributed data platforms (distributed systems) spanning from the edge to the cloud with security, reliability and network constraints in mind.Architect and design the data pipelines for AI/ ML heavy workloads in mind in order to extract crucial insights from the dataWork with product teams across the company to identify the needs of data and build out featuresHave a good knowledge of data modeling and distributed systems like Spark, Hadoop, Kafka, Elasticsearch etcHelp build a fast-growing team by mentoring other engineers and contribute to Dexterity’s strong customer focused cultureTech-lead several key initiatives and define the future Dexterity big data pipelines and platformBasic Qualifications:BA/BS Degree in Computer Science or related technical discipline, or related practical experience.10+ years of experience in software design, data engineering, data processing at scale and basic algorithm related solutions.7+ years of programming experience in Java, Python, C/C++, Rust, Go, or other relevant coding languagesHands-on experience developing/managing distributed systems or other large-scale systems.Preferred Qualifications:Experience with data infrastructure technologies like Kafka, Elasticsearch, HDFS, distributed tracing etc.Experience with observability/telemetry tech stack like Prometheus/Victoria metrics/ Grafana, Alert manager etcExperience with building solutions on a public cloud platform like GCP, Azure etc.Experience with industry, open-source projects and/or academic research in data management, data modeling, relational databases, and/or large-data, parallel and distributed systemsExperience with deploying solutions on an on-premise systems and on public cloud platformExperience in building data infrastructure for AI/ ML ecosystems #J-18808-Ljbffr