Sr. Software Engineer Data Platform

Flexport is building the first modern logistics platform to make global trade easier for everyone. We are solving complex problems on a global scale, and disrupting a multi-trillion dollar industry that has remained stubbornly unchanged.

The data platform forms the backbone for transporting data across our systems to drive Flexport Insights. Our team mission is to empower our engineering teams with common infrastructure to make the world's trade data accessible for modern analytics and machine learning. We're at an inflection point in our company's data narrative: we're moving to a modern Data Mesh Architecture in the midst of a company-wide SOA migration, and are looking for engineers to lead us in this transition.

High-quality software development is integral in allowing us to fulfill our mission of making global trade easier for everyone. At Flexport you’ll develop systems that are at the forefront of reshaping the entire logistics & supply chain industries.

You will:

-Be part of the data platform team and build a shared platform to stream data across our organization.

-Work closely with product managers, data science and analytics, and engineering to distill complex business problems into elegant technical solutions.

-Evolve the maturity of our monitoring systems and processes to improve visibility and failure detection in our infrastructure.

-Craft the engineering vision, and own the technical landscape, for our data platform

-Mentor and grow junior engineers.

What you’ll build:

-Foundational components of our data mesh, empowering teams to own their domain data products.

-Framework to express stateful batch and stream data processing workflows.

-Deliver supply chain insights to logistics teams via a world-class analytics experience.

You should have:

-5+ years of experience working with building analytics architectures and with batch and streaming technologies (e.g. Airflow, Hadoop, Hive, Kafka/Kinesis, Spark/Flink, and similar technologies)

-The ability to convey technical ideas in common terms to business partners, product managers, and engineers alike.

-A bias for action. When you see a problem, you solve it.

-An aptitude for learning quickly.

-Required: Experience in Python, Ruby, Java, Scala. Experience with AWS, GCP, or another cloud service provider.

-Ideally: Experience with Kinesis/Kafka, Flink/Spark/Beam, and Kubernetes.

Our stack: Our continuous releases are integrated with Buildkite and Github. Our data stack is in the process of moving from a Data Monolith on top of Snowflake, S3, Kinesis, Fivetran, and Airflow on Kubernetes into a Data Mesh architecture. Our stack is hosted on AWS using Docker and orchestrated primarily with Kubernetes.