
Data Pipeline Software Engineer - Data Cloud Portal
Dun & Bradstreet
Role Location
- Silicon Valley, CA, United States
Compensation
Employees
Address
Tech Stack
- Redshift
- Redis
- Zookeeper
- Kafka
- Akka
- DynamoDB
- Docker
- Node.js
- Numpy
- SciPy
- Scikit-Learn
- Tensorflow
- Hadoop
- Cascading
- AWS
- React
- Apache Spark
- Neptune
- Java
- Spring MVC
- Terraform
- MySQL
- JavaScript
- TypeScript
- GraphQL
- Selenium
- Puppet
- Scala
Role Description
Role Description:
- Join a newly formed elite team within Dun & Bradstreet (D&B) responsible for building the back end infrastructure for the Data Cloud Portal product.
- Key responsibilities include building big data pipelines in AWS and a microservices layer based on the Java Spring Framework.
- Data Cloud Portal will serve as the common ingestion platform across D&B for corporate data across all the company's products.
- This is a highly visible project with a global team geographically distributed across the San Francisco Bay Area, Boston Area, and Austin, with supporting teams in Beijing and Mexico City.
- The project's potential impact is in the $100Ms and this is a unique chance for a junior engineer to play a pivotal role in a crucial team.
Role Responsibilities:
- Design and code big data pipelines, specifically for ETL (Extract, Tranform, and Load) applications.
- Write MapReduce/Hadoop/Flink/Spark-based massively parallel data processing jobs.
- Interface with SQL databases, high throughput caching systems, and microservices.
- Collaborate with a highly cross-functional team of Product Managers, Project Managers, UX Designers, UI Software Engineers, DevOps, SysOps, Software Architects, and other Back End Engineers.
About Dun & Bradstreet
Dun & Bradstreet has the world’s most comprehensive business data sets and analytics capabilities to power today’s most crucial business needs. That’s why 90% of the Fortune 500, and companies of all sizes around the world, rely on Dun & Bradstreet to help grow and protect their business. Our engineering teams focus on developing industry-leading, highly scalable, SaaS based applications to put this data into action. We are solving extremely intellectually interesting problems using machine learning, artificial intelligence and high-performance distributed computing.
We are looking for individuals interested in building world-class SaaS applications and solving complex challenges with one of the world’s largest B2B data sets. We have a supportive team atmosphere, using the latest technologies, and always strive to ensure D&B is the best place to learn and grow your career.
Our leading SaaS B2B Product, D&B Lattice, is an early innovator in the hottest area of big data applied to predictive marketing. We combine thousands of data signals from our customers and partners, and extract key business insights using a variety of machine learning, ranging from random forest to deep learning, to better understand business drivers behind each purchase decision. Our innovative marketing and sales application predicts: who will buy, what they are likely to buy, and when.
Company Culture
Building a forward-leaning culture where people come first: Now, more than ever, we're focused on building a strong and supportive culture where people feel empowered, aren't afraid to fail, bring their true selves to work, and take time to recover when needed.
A few examples:
We eliminated layers and flattened the structure of our organization so that our leaders are approachable and more in tune with our people. Our 'Sustainable High Performance' program offers resources and support to our employees in 4 key areas to support personal growth: movement, mindset, nutrition and recovery. Dress For Your Day: We evolved our approach to our dress policy. We wear what makes sense for our day.
Address
Tech Stack
- Redshift
- Redis
- Zookeeper
- Kafka
- Akka
- DynamoDB
- Docker
- Node.js
- Numpy
- SciPy
- Scikit-Learn
- Tensorflow
- Hadoop
- Cascading
- AWS
- React
- Apache Spark
- Neptune
- Java
- Spring MVC
- Terraform
- MySQL
- JavaScript
- TypeScript
- GraphQL
- Selenium
- Puppet
- Scala
Skip straight to final-round interviews by applying through Triplebyte.
Other Roles at Dun & Bradstreet

Back End Software Engineer - D&B Connect
Remote
Backend Software Engineer
Silicon Valley, CA, United States
Big Data Engineer
Los Angeles, CA, United States, New York, NY, United States, San Francisco, CA, United States, Seattle, WA, United States, Silicon Valley, CA, United States, or Remote
Frontend Software Engineer
Austin, TX, United States, East Bay, CA, United States, San Francisco, CA, United States, Silicon Valley, CA, United States, or Remote
Microservices Software Engineer - Data Cloud Portal
Silicon Valley, CA, United States
Principal BE Software Engineer - D&B Connect
Remote
Senior Software Engineer
Austin, TX, United States, East Bay, CA, United States, Los Angeles, CA, United States, New York, NY, United States, San Francisco, CA, United States, Seattle, WA, United States, Silicon Valley, CA, United States, or Remote
Software Engineer II
Austin, TX, United States, Silicon Valley, CA, United States, or Remote
Software Engineer II
Austin, TX, United States, San Francisco, CA, United States, Silicon Valley, CA, United States, or Remote