Senior Data Engineer

Silicon Valley, CA, United States




Role Location

  • Silicon Valley, CA, United States


101 - 250 people


900 Middlefield Rd Ste 3
Redwood City, CA, 94063, US

Tech Stack

  • MySQL
  • Cassandra
  • Redis
  • Memcached
  • Python
  • Android
  • iOS
  • Java

Role Description

Shopkick is the most engaging rewards program, with an enthusiastic community of users who spend more time in-app and web than any other shopping experience. For consumers, we bring moments of joy to everyday shopping, dining, and leisure activities by offering fun ways to earn rewards (that we call kicks). They are similar to points in a mileage rewards program and can be redeemed for a wide variety of gift cards. For brands and retailers, we drive sales by providing high consumer engagement along the entire path to purchase--without the use of margin dilutive coupons. Our unique pay for performance model has been proven to deliver high ROI, driving incremental traffic, visits to shelves and stores, and sales across platforms: online, mobile and in-store. Some of our leading partners include Best Buy, Clorox, Coty, GSK, Georgia Pacific, Marshalls, Nestle, Purina, TJ Maxx, and Unilever, among others. Shopkick is available for free on the iPhone from the App Store and for Android on Google Play.

Shopkick is in search of a Senior Data Engineer. The Senior Data Engineer will be working with a team of Engineers, Data Analysts, and Data Scientists and will report to the Director of Architecture. The successful candidate will evangelize good data practices across the company, and work on a cutting-edge stream-based data platform running in the cloud. Essential duties and responsibilities may include, but are not limited to:

Provision and configure a Spark cluster in GCP for machine learning projects Apply a machine learning model to a stream of data flowing through StreamSets Analyze reporting requirements and design appropriate tables in our data warehouse Create tools to enable A/B test analysis Build a quick, scalable in-house funnel analysis tool Participate in architecture reviews to make sure that data considerations are taken into account in all new projects Qualifications

B.S., M.S. or Ph.D. in Computer Science or similar applied technical field Excellent programming skills using Python, Scala, or Java 3+ years experience with big data technologies Familiarity with SQL and NoSQL technologies Experience with Tableau, Superset or other reporting tools Experience with algorithms; understand general machine learning/data mining concepts Experience managing a Production Hadoop cluster Experience with Google Cloud Platform is a plus

About Shopkick

We're building the number one shopper profile on the planet by allowing consumers to get rewarded as they shop. The data that we collect allows companies to better understand how to do product and marketing spend.

Company Culture

We have smart, enthusiastic and humble coworkers who love to provide mentorship and learning opportunities.

Interested in this role?
Skip straight to final-round interviews by applying through Triplebyte.