Data Pipeline Software Engineer - Data Cloud Portal

Silicon Valley, CA, United States • 0.0% - 0.0%

Lattice Engines

Role Location

  • Silicon Valley, CA, United States


0.0% - 0.0%


101 - 250 people


1820 Gateway Dr Ste 200
San Mateo, CA, 94404, US

Tech Stack

  • Redshift
  • Redis
  • Zookeeper
  • Kafka
  • Akka
  • DynamoDB
  • Docker
  • Node.js
  • Numpy
  • SciPy
  • Scikit-Learn
  • Tensorflow
  • Hadoop
  • Cascading
  • AWS
  • React
  • Apache Spark
  • Neptune
  • Java
  • Spring MVC

Role Description

Role Description:

  • Join a newly formed elite team within Dun & Bradstreet (D&B) responsible for building the back end infrastructure for the Data Cloud Portal product.
    • Key responsibilities include building big data pipelines in AWS and a microservices layer based on the Java Spring Framework.
    • Data Cloud Portal will serve as the common ingestion platform across D&B for corporate data across all the company's products.
  • This is a highly visible project with a global team geographically distributed across the San Francisco Bay Area, Boston Area, and Austin, with supporting teams in Beijing and Mexico City.
  • The project's potential impact is in the $100Ms and this is a unique chance for a junior engineer to play a pivotal role in a crucial team.

Role Responsibilities:

  • Design and code big data pipelines, specifically for ETL (Extract, Tranform, and Load) applications.
  • Write MapReduce/Hadoop/Flink/Spark-based massively parallel data processing jobs.
  • Interface with SQL databases, high throughput caching systems, and microservices.
  • Collaborate with a highly cross-functional team of Product Managers, Project Managers, UX Designers, UI Software Engineers, DevOps, SysOps, Software Architects, and other Back End Engineers.

About Lattice Engines

Lattice is an early innovator in the hottest area of big data applied to predictive marketing. We combine thousand of data signals from our customers and partners, and extract key business insights using a variety of machine learning, ranging from random forest to deep learning, to better understand business drivers behind each purchase decision. We can help companies predict: Who is going to be your next customer? What will they buy? How much will they spend with you ? And when are they ready to buy?

Company Culture

We have very talented people with a lot of data scientists and PhD working at the company. We take our culture very seriously and our core values are: - create visible value - stay accountable - trade places - embrace your quirkiness - communicate respectfully - find a mentor/be a mentor - celebrate what's great - be a steward

Interested in this role?
Skip straight to final-round interviews by applying through Triplebyte.