1. Home
  2. Software Engineering Jobs
  3. San Francisco Bay Area, CA
  4. Apache Spark
Switch to Employers listing

Software Engineering Jobs

Listing roles in the San Francisco Bay Area | Filtered on technology: Apache Spark

Filter by Location

Filter by Role

Filter by Technology & Language

Developer Tools Engineer at Palantir

New York, NY and San Francisco Bay Area, CA
501+ employees
Palantir builds the world's leading software for data-driven operations and decision-making.
The Role Developer Tools is a globally-distributed team responsible for the toolchain used by Palantir developers. We own the pipeline in full, from committing code to shipping artifacts. Today - with our team members writing code in multiple languages and running more than 30,000 builds per...
Role for: DevOps Engineer
Technologies: Java AngularJS React Apache Spark Elasticsearch Hadoop Cassandra Spark AWS Typescript Redux PostgreSQL AngularJS Kubernetes Docker Go

Data Pipeline Software Engineer - Data Cloud Portal at Lattice Engines

San Francisco Bay Area, CA
101 - 250 employees
Lattice helps companies understand their ideal customers profile and predict who is going to be their next customers.
**Role Description:** - Join a newly formed elite team within Dun & Bradstreet (D&B) responsible for building the back end infrastructure for the Data Cloud Portal product. - Key responsibilities include building big data pipelines in AWS and a microservices layer based on the Java Spring...
Role for: Back-End Engineer
Technologies: Redshift Redis Zookeeper Kafka Akka DynamoDB Docker Node.js Numpy SciPy Scikit-Learn Tensorflow Hadoop Cascading AWS React Apache Spark Neptune Java Spring MVC

Front-end/Product Engineer at Heap

Remote and San Francisco Bay Area, CA
101 - 250 employees
Analytics infrastructure for the internet.
As a product engineer at Heap, you’ll build the products that make user behavior useful for everyone. We have a unique approach to understanding user behavior: capture all the data. This allows people to use Heap who were previously shut out from using analytics at all, so one of the core...
Role for: Front-End Engineer Full-Stack Engineer
Technologies: Typescript Scala PostgreSQL Node.js Redis Kafka Zookeeper Terraform React Apache Spark Android Objective-C

Senior Backend Engineer at ScaleMonk

San Francisco Bay Area, CA
11 - 25 employees
State-of-the-art user acquisition as a service
You will work on cutting edge high performance, high transaction and volume rate data with very low latency. Our system handles 1 million requests per second and responds in milliseconds. You will also deploy cutting edge machine learning models into production. Our system trains artificial...
Role for: Back-End Engineer ML Engineer / Data Scientist
Technologies: Go Python Hadoop Apache Spark Tensorflow Keras JavaScript Typescript Angular HTML5 HTML CSS PyTorch XGBoost SQL

Engineering Manager, Big Data Infrastructure at LiveRamp

San Francisco Bay Area, CA
501+ employees
LiveRamp powers exceptional experiences by making it safe and easy to connect the world’s data, people, and applications.
LiveRamp is looking for an Engineering Manager to help support and grow developers in our Big Data infrastructure organization. As an Engineering Manager, you are responsible for helping your developers successful by setting context, resolving blockers, removing distractions, instituting smart...
Role for: Back-End Engineer
Technologies: Java MySQL Go Kubernetes Hadoop Apache Spark Kafka React Ruby on Rails Google Cloud

Senior Software Engineer at Lattice Engines

San Francisco Bay Area, CA
101 - 250 employees
Lattice helps companies understand their ideal customers profile and predict who is going to be their next customers.
Lattice Engines (A Dun & Bradstreet Company) is looking for intelligent and hardworking software engineers to accelerate our path towards becoming the number one Customer Data Platform. This role involves working in an agile team to build the systems that will allow our platform to connect to...
Role for: Back-End Engineer
Technologies: Redshift Redis Zookeeper Kafka Akka DynamoDB Docker Node.js Numpy SciPy Scikit-Learn Tensorflow Hadoop Cascading AWS React Apache Spark Neptune Java Spring MVC

Mobile SDK Engineer at Heap

Remote and San Francisco Bay Area, CA
101 - 250 employees
Analytics infrastructure for the internet.
The Mobile team at Heap brings the magic of auto-capture to native iOS and Android apps. This is no easy feat: capturing every user interaction accurately and without performance impact is quite technically challenging. We’re looking for experienced mobile engineers to bring domain expertise to...
Role for: Mobile Engineer
Technologies: Typescript Scala PostgreSQL Node.js Redis Kafka Zookeeper Terraform React Apache Spark Android Objective-C

Data Scientist / ML Engineer at ScaleMonk

San Francisco Bay Area, CA
11 - 25 employees
State-of-the-art user acquisition as a service
Develop behavioral models for billions of mobile users. Create predictive models for user revenue. Explore new approaches to improving predictive power. These models will be deployed into production and directly control spend. This role has enormous impact. The models we build are extreme...
Role for: ML Engineer / Data Scientist
Technologies: Go Python Hadoop Apache Spark Tensorflow Keras JavaScript Typescript Angular HTML5 HTML CSS PyTorch XGBoost SQL

Software Infrastructure Engineer at Palantir

San Francisco Bay Area, CA and Seattle, WA
501+ employees
Palantir builds the world's leading software for data-driven operations and decision-making.
A World-Changing Company At Palantir, we’re passionate about building software that solves problems. We partner with the most important institutions in the world to transform how they use data and technology. Our software has been used to stop terrorist attacks, discover new medicines, gain an...
Role for: Back-End Engineer
Technologies: Java AngularJS React Apache Spark Elasticsearch Hadoop Cassandra Spark AWS Typescript Redux PostgreSQL AngularJS Kubernetes Docker Go

Senior Software Engineer, Data Science at LiveRamp

San Francisco Bay Area, CA
501+ employees
LiveRamp powers exceptional experiences by making it safe and easy to connect the world’s data, people, and applications.
About LiveRamp LiveRamp is the leader in data connectivity, helping the world’s largest brands use their data to improve customer interactions on any channel and device. We thrive on mind-bending technical challenges and value entrepreneurship, humility, and constant personal growth. Our Data...
Role for: Back-End Engineer
Technologies: Java MySQL Go Kubernetes Hadoop Apache Spark Kafka React Ruby on Rails Google Cloud

Data Science Engineer at Lattice Engines

San Francisco Bay Area, CA
101 - 250 employees
Lattice helps companies understand their ideal customers profile and predict who is going to be their next customers.
We are looking for talented Data Engineers who want to transition into a combined Data Science and Data Engineering role as a member of the data science team. This central role will include a range of responsibilities. Part of the role will be to participate in groundbreaking R&D projects to...
Role for: Back-End Engineer
Technologies: Redshift Redis Zookeeper Kafka Akka DynamoDB Docker Node.js Numpy SciPy Scikit-Learn Tensorflow Hadoop Cascading AWS React Apache Spark Neptune Java Spring MVC

UIUX Frontend Engineer at ScaleMonk

San Francisco Bay Area, CA
11 - 25 employees
State-of-the-art user acquisition as a service
Seeking an experienced Frontend Engineer to build a next generation B2B product. Must be able to create rich, data driven visual experiences that bring user delight. Must have strong expertise in Javascript in conjunction with modern frontend technologies, frameworks, etc. Extra points if you...
Role for: Front-End Engineer
Technologies: Go Python Hadoop Apache Spark Tensorflow Keras JavaScript Typescript Angular HTML5 HTML CSS PyTorch XGBoost SQL

Sr. Full Stack Engineer, Measurement at LiveRamp

San Francisco Bay Area, CA
501+ employees
LiveRamp powers exceptional experiences by making it safe and easy to connect the world’s data, people, and applications.
LiveRamp's product is a massive identity graph connecting each individual to their online identifiers like cookies and device IDs. Our engineering workflows can be broken into three parts: Data Ingestion, Data Manipulation, and Data Distribution. We ingest behavioral data indexed by offline...
Role for: Full-Stack Engineer
Technologies: Java MySQL Go Kubernetes Hadoop Apache Spark Kafka React Ruby on Rails Google Cloud

Software Engineer at SafeGraph

Remote and San Francisco Bay Area, CA
26 - 50 employees
Predicting the past
- Core software engineer. - Reporting to SafeGraph's CTO. - Work as an individual contributor. - Opportunities for future leadership. ### About you: - Care deeply about democratizing access to data. - Passionate about big data and are excited by seemingly-impossible challenges. - At least...
Role for: Back-End Engineer
Technologies: Apache Spark Scala AWS

Software Engineer, Data Platform at TRM Labs

San Francisco Bay Area, CA
< 10 employees
Building an open financial system
TRM leverages big data and machine learning to prevent cryptocurrency fraud and financial crime. Our goal is to build a safer financial system for billions of people. To achieve this goal, we need highly available data infrastructure. As such, we're looking for passionate Data Engineers to join...
Role for: Back-End Engineer
Technologies: React Redux Node.js PostgreSQL Heroku AWS Google Cloud MongoDB Apache Spark ClickHouse Redis

Senior Frontend Engineer at Scoop

San Francisco Bay Area, CA
101 - 250 employees
Scoop brings commuters together in carpools they love by partnering with their employers.
## In this role, you will: * Work with product management and design to build new features with JavaScript, semantic HTML, and CSS best practices * Collaborate on a design system for building and maintaining a robust set of well-structured, reusable components, layouts, and paradigms to span our...
Role for: Front-End Engineer
Technologies: Node.js Scala Apache Spark AWS iOS Development Android Python Swift

Backend Software Engineer at Lattice Engines

San Francisco Bay Area, CA
101 - 250 employees
Lattice helps companies understand their ideal customers profile and predict who is going to be their next customers.
You will work with our top engineers across our platform, data science, and frontend teams to implement a cutting-edge product that will challenge you and your teammates technically and intellectually. Daily you will be working with other engineers, product managers, and designers to invent the...
Role for: Back-End Engineer
Technologies: Redshift Redis Zookeeper Kafka Akka DynamoDB Docker Node.js Numpy SciPy Scikit-Learn Tensorflow Hadoop Cascading AWS React Apache Spark Neptune Java Spring MVC

Senior Software Engineer, Backend at LiveRamp

San Francisco Bay Area, CA
501+ employees
LiveRamp powers exceptional experiences by making it safe and easy to connect the world’s data, people, and applications.
You will: Build distributed, scalable, and reliable data pipelines that process petabytes of data per day Identify and implement optimizations, algorithmic changes, and architectural improvements to increase the scaling abilities of our pipelines and align with best practices. Identify and...
Role for: Back-End Engineer
Technologies: Java MySQL Go Kubernetes Hadoop Apache Spark Kafka React Ruby on Rails Google Cloud

Software engineer - Machine Learning at Grammarly

San Francisco Bay Area, CA
101 - 250 employees
Grammarly’s AI-powered products help people communicate more effectively.
Help build AI/ML-powered functionality at Grammarly
Role for: Back-End Engineer
Technologies: Java Python AngularJS Apache Spark Scala React Typescript Clojure Android

Machine Learning Engineer at SafeGraph

Remote and San Francisco Bay Area, CA
26 - 50 employees
Predicting the past
Veraset, a division of SafeGraph, is looking for a Data Engineer to build, scale, and monitor pipelines that process hundreds of terabytes of geospatial data daily, to join our fast-growing team. Veraset is a well funded, early-stage, profitable startup in the data-as-a-service space. You'll be...
Role for: ML Engineer / Data Scientist
Technologies: Apache Spark Scala AWS

Data Engineer at wellio

San Francisco Bay Area, CA
26 - 50 employees
Wellio is developing technology helping people eat better
About Wellio We believe that using technology, collaboration, innovation, and diversity, we can transform the way people eat and cook. We are a growing foodTech company with the goal of empowering families to eat healthier meals. We are building an AI platform that uses advanced machine...
Role for: ML Engineer / Data Scientist
Technologies: Google Cloud Python React Native React Flask CircleCI Apache Spark Kubernetes Docker Tensorflow Elastic Search Redis

Back-end Engineer at Cardiogram

San Francisco Bay Area, CA
< 10 employees
Save lives using wearable heart rate data
We are looking to dramatically expand the capabilities of our data at scale - we can't wait to get started building search, data analysis, pipelines, graphs. You will be driving this technical work, making design decisions, deploying new services, and implementing new processes. You will also be...
Role for: Back-End Engineer
Technologies: React Node.js Webpack PostgreSQL RabbitMQ Apache Spark JavaScript Swift

Software Engineer, Backend at TRM Labs

San Francisco Bay Area, CA
< 10 employees
Building an open financial system
TRM leverages big data and machine learning to prevent cryptocurrency fraud and financial crime. Our goal is to build a safer financial system for billions of people. To achieve this goal, we need highly available backend infrastructure that allows us to detect risk at scale. As such, we're...
Role for: Full-Stack Engineer
Technologies: React Redux Node.js PostgreSQL Heroku AWS Google Cloud MongoDB Apache Spark ClickHouse Redis

Infra/Full-Stack at Heap

Remote and San Francisco Bay Area, CA
101 - 250 employees
Analytics infrastructure for the internet.
Heap’s mission is to power business decisions with truth. We empower companies to focus on what matters — discovering insights and taking action — not building pipelines or tagging. With Heap, organizations of all sizes can remove technical bottlenecks and gain a single comprehensive view of...
Role for: Full-Stack Engineer
Technologies: Typescript Scala PostgreSQL Node.js Redis Kafka Zookeeper Terraform React Apache Spark Android Objective-C

Senior Software Engineer , Big Data Infrastructure at LiveRamp

San Francisco Bay Area, CA
501+ employees
LiveRamp powers exceptional experiences by making it safe and easy to connect the world’s data, people, and applications.
LiveRamp is looking for a Senior Software Engineer to help us maintain and scale our Big Data infrastructure. Our data infrastructure team helps application teams manage several Hadoop clusters of different sizes, many with tens of thousands of cores and terabytes of RAM. We’re also responsible...
Role for: Back-End Engineer
Technologies: Java MySQL Go Kubernetes Hadoop Apache Spark Kafka React Ruby on Rails Google Cloud
Be the first to hear about new roles like these!