Sr Data Engineer

  • location: Novato, CA
  • type: Permanent
  • salary: $125,000 - $190,000 per year

job description

Sr Data Engineer

job summary:
WHO WE ARE:

The Marketing Technology team works alongside our Marketing, Community and PR teams, managing and supporting the underlying technology stack used for Paid, Owned and Earned Marketing activity.

You'll be apart our MarTech team as a Sr. Data Engineer, which will require you to think on your feet with a strong focus on delivery, by enabling change within a creative and rapidly changing environment.

THE CHALLENGE:

The responsibilities include the ability to develop robust end to end data pipelines of disparate data into consistent usable data. This role requires an understanding of big data pipelines and experience getting them operating without the need for manual intervention.

WHAT YOU'LL TACKLE:

  • Develop and manage stable, scalable data pipelines that cleanse, structure and integrate disparate big data sets into a readable and accessible format for end user analyses and targeting using stream and batch processing architectures.
  • Develop and improve the current data architecture, data quality, monitoring and data availability.
  • Collaborate with the labels to incorporate new data sources into the growing data model.
  • Develop data quality framework to ensure delivery of high-quality data and analyses to stakeholders.
  • Overall responsibility for maintenance of enterprise wide data dictionary.
  • Define and implement monitoring and alerting policies for data solutions.
WHAT YOU BRING:

  • Experience with large data sets and distributed computing. (Hive/Hadoop)
  • 5+ years of experience with detailed knowledge of data warehouse technical architectures, infrastructure components, ETL/ ELT and reporting/analytic tools.
  • 4+ years of hands-on experience working with AWS technologies stack including Redshift, RDS, S3, EMR, Treasure Data, Snowflake or similar solutions build around Hive/Spark etc.
  • 4+ years of hands-on experience in using advanced SQL queries (analytical functions), experience in writing and optimizing highly efficient SQL queries.
  • Proven track record of delivering big data solutions - batch and real-time.
  • Ability to design, develop and automate scalable ETL and reporting solutions that transforms data into accurate and actionable business information.
  • Comfort in working with business customers to gather requirements and gain a deep understanding of varied datasets.
  • Experienced in testing and monitoring data for anomalies and rectifying them.
  • Knowledge of software coding practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations.
Technologies you will work with

  • Presto SQL
  • Hive SQL
  • Digdag
  • Embulk
  • Python
 
location: Novato, California
job type: Permanent
salary: $125,000 - 190,000 per year
work hours: 9am to 5pm
education: Bachelors
 
responsibilities:
THE CHALLENGE:

The responsibilities include the ability to develop robust end to end data pipelines of disparate data into consistent usable data. This role requires an understanding of big data pipelines and experience getting them operating without the need for manual intervention.

WHAT YOU'LL TACKLE:

  • Develop and manage stable, scalable data pipelines that cleanse, structure and integrate disparate big data sets into a readable and accessible format for end user analyses and targeting using stream and batch processing architectures.
  • Develop and improve the current data architecture, data quality, monitoring and data availability.
  • Collaborate with the labels to incorporate new data sources into the growing data model.
  • Develop data quality framework to ensure delivery of high-quality data and analyses to stakeholders.
  • Overall responsibility for maintenance of enterprise wide data dictionary.
  • Define and implement monitoring and alerting policies for data solutions.
 
qualifications:
  • Experience level: Experienced
  • Minimum 5 years of experience
  • Education: Bachelors
 
skills:
  • DATACENTER
  • Network Engineer
  • System Engineer
  • Presto SQL
  • Hive SQL
  • Digdag
  • Embulk
  • Python
  • HIVE
  • Hadoop
  • ETL
  • treasure data
  • SQL
  • SQL Server
  • SQL Database developer
  • SQL Database admin

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

Qualified applicants in San Francisco with criminal histories will be considered for employment in accordance with the San Francisco Fair Chance Ordinance.

We will consider for employment all qualified Applicants, including those with criminal histories, in a manner consistent with the requirements of applicable state and local laws, including the City of Los Angeles' Fair Chance Initiative for Hiring Ordinance.

get jobs in your inbox.

sign up
{{returnMsg}}

related jobs

    Big Data Engineer

  • location: San Francisco, CA (remote)
  • job type: Permanent
  • salary: $150,000 - $180,000 per year
  • date posted: 7/21/2021

    Data Engineer

  • location: San Francisco, CA
  • job type: Contract
  • salary: $130 - $140 per hour
  • date posted: 7/15/2021

    Sr Product Owner

  • location: San Francisco, CA
  • job type: Contract
  • salary: $68.66 - $70 per hour
  • date posted: 7/1/2021