Sr. Data Engineer - Data Lake - Lead

  • location: Pennington, NJ
  • type: Contract
  • salary: $58 - $68 per hour

job description

Sr. Data Engineer - Data Lake - Lead

job summary:
Sr. Data Engineer - Data Lake - Lead

  • Our organization is modernizing our HR data & analytics technology services inclusive of self-serve & API-driven access to Big Data. The Sr. Data Engineer-Data Lake will fill a lead role on the Client's Global Human Resources Technology, Data Lake Development Team. We are looking for a well-rounded data engineer who ""gets it"" and sets the example for effective collaboration in a team environment. Candidate must demonstrate excellent communication skills and critical thinking to ensure all assumptions, constraints, behaviors are well thought through. The individual ensures the systems design and requirements are aligned to achieve the desired business outcomes, and that team practices and coding/quality principles are aligned to achieve the desired technology outcomes. This individual will deliver developing complex solutions in Data Lake environment, involving technical design, development, testing.
  • The desired individual will have demonstrated experience in standing up Big Data operational & analytics platforms, translating business requirements to scalable & sustainable technical solutions. Qualified candidates must be well-versed in data warehousing and 'Big Data' distributed processing and storage technologies as well as Data Lake design pattern. In addition, the selected candidate should have knowledge and experience with data management techniques such as Meta data management , Data Quality (DQ) management, Data Governance, Data Integration/Ingestion, Data Architecture, and Data Profiling.
Responsibilities include:

  • developing and scripting in Python programming as well as SQL in Linux environments.
  • integrating data with Sqoop and ingest files of multi-record types with various data formats Parquet, Avro, and Json.
  • Create and maintain optimal data pipeline architecture in Cloudera CDH or similar platform with application development skills in hive, Sqoop, Pyspark
  • Participate in status meetings to track progress, resolve issues, articulate & mitigate risks and escalate concerns in a timely manner.
  • understands and evangelizes great design, engineering, & organizational practices (unit testing, release procedures, coding design and documentation protocols) that meet/exceed the Client's change management procedures
  • sets the bar for team communications and interactions-is an excellent teammate to peers, influencing them in a positive direction
  • uses versioning tools such as GIT/Bit bucket
  • sets up jobs using autosys for automation
 
location: Pennington, New Jersey
job type: Contract
salary: $58 - 68 per hour
work hours: 8am to 5pm
education: Bachelors
 
responsibilities:
  • Our organization is modernizing our HR data & analytics technology services inclusive of self-serve & API-driven access to Big Data. The Sr. Data Engineer-Data Lake will fill a lead role on the Client's Global Human Resources Technology, Data Lake Development Team. We are looking for a well-rounded data engineer who ""gets it"" and sets the example for effective collaboration in a team environment. Candidate must demonstrate excellent communication skills and critical thinking to ensure all assumptions, constraints, behaviors are well thought through. The individual ensures the systems design and requirements are aligned to achieve the desired business outcomes, and that team practices and coding/quality principles are aligned to achieve the desired technology outcomes. This individual will deliver developing complex solutions in Data Lake environment, involving technical design, development, testing.
  • The desired individual will have demonstrated experience in standing up Big Data operational & analytics platforms, translating business requirements to scalable & sustainable technical solutions. Qualified candidates must be well-versed in data warehousing and 'Big Data' distributed processing and storage technologies as well as Data Lake design pattern. In addition, the selected candidate should have knowledge and experience with data management techniques such as Meta data management , Data Quality (DQ) management, Data Governance, Data Integration/Ingestion, Data Architecture, and Data Profiling.
 
qualifications:
  • Experience level: Experienced
  • Minimum 10 years of experience
  • Education: Bachelors
 
skills:
  • Data Engineer
  • Data Lake
  • Hadoop
  • Hadoop

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

get jobs in your inbox.

sign up
{{returnMsg}}

related jobs

    Big Data Engineer

  • location: Pennington, NJ
  • job type: Contract
  • salary: $58 - $68 per hour
  • date posted: 7/26/2021

    Sr. SAS Programmer

  • location: Princeton, NJ
  • job type: Permanent
  • salary: $100,000 - $105,000 per year
  • date posted: 7/8/2021

    Sr Cloud PM

  • location: Princeton, NJ
  • job type: Contract
  • salary: $65 - $75 per hour
  • date posted: 7/21/2021