Our client in the greater Austin area is seeking an experienced Senior Data Engineer to help transform the way car dealers and manufacturers think about products and profits. As part of the company's growing Data Engineering team, we're looking for someone to design, develop and implement technology and data solutions to meet current and future data warehousing and reporting needs. An experienced engineer who can set the technical direction, establish best practices, and partner with all consumers of data to build and support the company's data engineering platform.Senior Data Engineer to help transform the way car dealers and manufacturers think about products and profits.
location: Austin, Texas
job type: Permanent
salary: $160,000 - 180,000 per year
work hours: 8am to 4pm
? Lead the team in the designing, building of stable, scalable data pipelines or ETL processes that cleanse, structure, and integrate big data sets from multiple data sources into Snowflake
? Lead the team in supporting existing data pipelines
? Identify and champion initiatives that improve current processes
? Coach and mentor team members on data engineering best practices and promote team development and growth
? Clearly and effectively communicate with other team members through technical design documentation
? Facilitate group discussions around technical solutions to business problems
? Be willing to design and build REST APIs to different data sources
? Design and implement relational and dimensional models in Snowflake.
? Collaborate with Product and other engineering teams on normalizing and aggregating large data sets based on business needs and requirements.
? Work on different databases (Snowflake, Postgres, MySQL, NoSql)
? Work with different data formats (JSON, CSV, Parquet, Avro) and interact with various on-premise and cloud data sources as well as RESTful APIs.
? Establish, maintain and administer Snowflake clusters and other data infrastructure
? Implement systems for tracking data quality and consistency Qualifications:
? 8+ years of experience in a data engineering role
? Must have 2+ years of experience in Snowflake or similar data warehouse systems
? SQL skills and experience
? programming skills in Python or other language (Java, Ruby)
? Knowledge and expertise in system performance and optimization, schema design, and, capacity planning
? Proven ability to design, develop, and maintain data warehousing and ETL workflows for large data sets and interact with various sources
? Knowledge of industry-standard ETL and workflow tools (Airflow or another 3rd party), as well as writing your own utilizing Python is preferred
? Working experience with Amazon Web Services (S3, EC2, Lambda, Data Pipeline)
? Hands-on experience and expertise in using advanced Snowflake//MySql/Postgres SQL features, specifically analytical functions.
- Experience level: Experienced
- Minimum 8 years of experience
- Education: Bachelors (required)
- Data Engineer (8 years of experience is required)
- Snowflake (2 years of experience is required)
- SQL (8 years of experience is required)
- Python (5 years of experience is preferred)
- JAVA DEVELOPER (5 years of experience is preferred)
- Ruby (5 years of experience is preferred)
- AMAZON WEBSERVICE (2 years of experience is preferred)
- ETL (8 years of experience is required)
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.