Senior Software Engineer, Big Data (Data Management)

San Francisco • $120k - $180k

LiveRamp


Role Location

  • San Francisco

Compensation

$120k - $180k

Employees

501+ people

Address

225 Bush St Ste 1700
San Francisco, CA, 94104, US

Tech Stack

  • Java
  • MySQL
  • Go
  • Kubernetes
  • Hadoop
  • Apache Spark
  • Kafka
  • React
  • Ruby on Rails
  • Google Cloud
  • Apache Spark

Role Description

At LiveRamp, we are on a quest to build the most flexible and scalable data marketplace. The platform underlying the marketplace ingests, analyzes, enriches and transforms tens of petabytes of data per day and then delivers the enriched data to our customers. Powering it is a massive Hadoop cluster with over 80K cores and counting. The cluster hosts over 15 petabytes of data.

You will:

Build distributed, scalable, and reliable data pipelines that ingest and process petabytes of data per day Work on a massively scalable segmentation engine that performs real time segmentation with accurate counts for people-based marketing. If you enjoy advanced query processing engines, indexing strategies, and database engines in general, this could be a fit. Help lead and mentor your fellow engineers as they tackle challenging problems such as implementing SOA and Kubernetes at scale, building our new cloud platform, and migrating our data tier to GCP. Leverage vendors and open source technologies as we complete our migration to the cloud. Own product features from the development phase through to production deployment. Evaluate big data technologies and prototype solutions to improve our data processing architecture. About you:

Around 5+ years of experience writing and deploying production code of which at least 2+ years’ experience is working on a Big Data Platform You love mentoring junior engineers and deploying best practices Extensive experience with data processing platforms such as Hadoop, Spark, Hive, Pig Solid understanding of large-scale data processing systems Proficient in one or more of Java, Go, C++, Scala Understanding of automated QA needs related to Big data Experience with Cloud providers like AWS, Azure; GCP preferable Bonus points:

Experience with modern datastores such as MongoDB, Cassandra, Riak, Azure Cosmos DB, Aerospike Stream processing - Spark streaming, Apache Storm, Flink Experience with Search indexing such as Lucene, Solr, Nutch, Elasticsearch Experience with designing and implementing interfaces and infrastructure for large volume services and APIs Benefits:

People. Work with talented, collaborative, and friendly people who love what they do. Food. Enjoy catered meals, boundless snacks, and the occasional food truck. Fun. We host events such as game nights, happy hours, camping trips, and sports leagues. Stock. Every employee is a stakeholder in our future. Health and Saving. Receive the benefits of comprehensive health, dental, vision and disability insurance along with a 401k matching plan. Location. Work in the heart of San Francisco and take advantage of our commuter benefits.

About LiveRamp

LiveRamp's product is a massive identity graph connecting each individual to their online identifiers like cookies and device IDs.

Our engineering workflows can be broken into three parts: Data Ingestion, Data Manipulation, and Data Distribution. We ingest behavioral data indexed by offline and online identifiers from our clients, resolve every index to a single LiveRamp ID through our Identity Graph, and then distribute ingested data to other technology platforms in the industry.

Company Culture

All LiveRampers are smart, nice, and get things done. We move quickly and value autonomy and project ownership over all else. We empower our people to use their best judgment when making decisions. We grow our talent by challenging them with stretch projects and supporting them with mentorship.

Interested in this role?
Skip straight to final-round interviews by applying through Triplebyte.