Senior Data Engineer

  • location: Malvern, PA
  • type: Contract
easy apply

job description

Senior Data Engineer

job summary:
To provide expert level technical lead and data services. To create data solutions for complex business problems and strategic questions. Provides direction, evaluation, selection, configuration, implementation, and integration of new and existing technologies and tools for data analysis, model development and other advanced analytics needs. . Creates sophisticated data solutions to business problems for advanced analytics. Partner with IT to build data lake.

 
location: Malvern, Pennsylvania
job type: Contract
work hours: 9am to 5pm
education: Bachelors
 
responsibilities:
1. AWS Big Data Engineer with minimum 8 years of experience.

2. Senior-level candidate with strong conceptual thinking skills. Should be able to think at solution level on

how data should be manipulated and stored from one stage of Data Lake to another - Must have.

3. Ability to write ETL in python/scala, Spark, experience with ETL tools in AWS - Must have

4. Experience with implementation using following AWS data technologies - S3, RDS Postgres, Redshift -

Must have.

5. Ability to create Architecture diagrams and detailed design- Not required but nice to have

6. Experience with Data Warehousing concepts like star schemas, creation of history, ETL tools - Nice to

have

7. AWS certification in Big data technologies (Architecture, data engineering) - Nice to have.

8. Self-sufficient from design to execution.

Job Description Duties and Responsibilities

1. Creates sophisticated data solutions to business problems for advanced analytics. Partner with the Advanced

Analytics team to collect, parse, transform, manage very large scale datasets to generate insights. Develop

sustainable data solutions to enable analytics and implementation of insights.

2. Identifies potential data solutions, translates data solutions into design specifications and code. Responsible

for writing complex programs, ad hoc queries, and reports using team procedures and tool selection guidelines.

Ensures that all code is developed in a well-structured manner - includes sufficient documentation - and is easy

to maintain and reuse. Uses latest technologies to manage expanding external / internal, structured /

unstructured data sources.

3. Elevates complex technical issues to IT partners, including architects and vendors. Resolves technical

problems discovered by testers and internal clients. Responds to and resolves technical issues in a timely

manner. Researches issues and performs root cause analysis.

4. Understands how to apply technologies to solve big data challenges to support analytics needs. Develops and

applies extensive knowledge in different programming languages and databases, stays abreast with latest

industry / technology development for data solutions.

5. Develops deep expertise on client's data environment, new data sources, big data technology and

solutions and industry trends. Partners with internal clients to enhance understanding of business functions and

informational needs.

6. Partners closely with other technical leads, including advanced analytics teams, marketing technology group,

IT, and business clients to develop and implement appropriate data solutions for business problems and their

implications. Evaluates the impacts of solutions on own/shared technologies and effectively persuades and

influences others on ideas.

7. Participates in design, code, and test inspections throughout product life cycle for data solutions. Participates

as a technical consultant at other project meetings.

8. Understands and enforces team development guidelines. Mentors and develops staff with less experience.

Helps the team to resolve issues and conflict. Designs and conducts training sessions on tools and data sources

used by the team and self provisioners. Provides supporting documentation to team members and business

partners as needed.

9. Understands, complies with and enforces team policies and procedures, especially those for quality and

productivity standards that enable the team to meet established milestones. Understands, complies with and

enforces all Information Security policies and procedures, and verifies deliverables meet Information Security

requirements. Abides by Risk Controls as defined in the team CAF Documentation.

 
qualifications:
1. AWS Big Data Engineer with minimum 8 years of experience.

2. Senior-level candidate with strong conceptual thinking skills. Should be able to think at solution level on

how data should be manipulated and stored from one stage of Data Lake to another - Must have.

3. Ability to write ETL in python/scala, Spark, experience with ETL tools in AWS - Must have

4. Experience with implementation using following AWS data technologies - S3, RDS Postgres, Redshift -

Must have.

5. Ability to create Architecture diagrams and detailed design- Not required but nice to have

6. Experience with Data Warehousing concepts like star schemas, creation of history, ETL tools - Nice to

have

7. AWS certification in Big data technologies (Architecture, data engineering) - Nice to have.

8. Self-sufficient from design to execution.

Job Description Duties and Responsibilities

1. Creates sophisticated data solutions to business problems for advanced analytics. Partner with the Advanced

Analytics team to collect, parse, transform, manage very large scale datasets to generate insights. Develop

sustainable data solutions to enable analytics and implementation of insights.

2. Identifies potential data solutions, translates data solutions into design specifications and code. Responsible

for writing complex programs, ad hoc queries, and reports using team procedures and tool selection guidelines.

Ensures that all code is developed in a well-structured manner - includes sufficient documentation - and is easy

to maintain and reuse. Uses latest technologies to manage expanding external / internal, structured /

unstructured data sources.

3. Elevates complex technical issues to IT partners, including architects and vendors. Resolves technical

problems discovered by testers and internal clients. Responds to and resolves technical issues in a timely

manner. Researches issues and performs root cause analysis.

4. Understands how to apply technologies to solve big data challenges to support analytics needs. Develops and

applies extensive knowledge in different programming languages and databases, stays abreast with latest

industry / technology development for data solutions.

5. Develops deep expertise on client's data environment, new data sources, big data technology and

solutions and industry trends. Partners with internal clients to enhance understanding of business functions and

informational needs.

6. Partners closely with other technical leads, including advanced analytics teams, marketing technology group,

IT, and business clients to develop and implement appropriate data solutions for business problems and their

implications. Evaluates the impacts of solutions on own/shared technologies and effectively persuades and

influences others on ideas.

7. Participates in design, code, and test inspections throughout product life cycle for data solutions. Participates

as a technical consultant at other project meetings.

8. Understands and enforces team development guidelines. Mentors and develops staff with less experience.

Helps the team to resolve issues and conflict. Designs and conducts training sessions on tools and data sources

used by the team and self provisioners. Provides supporting documentation to team members and business

partners as needed.

9. Understands, complies with and enforces team policies and procedures, especially those for quality and

productivity standards that enable the team to meet established milestones. Understands, complies with and

enforces all Information Security policies and procedures, and verifies deliverables meet Information Security

requirements. Abides by Risk Controls as defined in the team CAF Documentation.

 
skills: 1. AWS Big Data Engineer with minimum 8 years of experience.

2. Senior-level candidate with strong conceptual thinking skills. Should be able to think at solution level on

how data should be manipulated and stored from one stage of Data Lake to another - Must have.

3. Ability to write ETL in python/scala, Spark, experience with ETL tools in AWS - Must have

4. Experience with implementation using following AWS data technologies - S3, RDS Postgres, Redshift -

Must have.

5. Ability to create Architecture diagrams and detailed design- Not required but nice to have

6. Experience with Data Warehousing concepts like star schemas, creation of history, ETL tools - Nice to

have

7. AWS certification in Big data technologies (Architecture, data engineering) - Nice to have.

8. Self-sufficient from design to execution.

Job Description Duties and Responsibilities

1. Creates sophisticated data solutions to business problems for advanced analytics. Partner with the Advanced

Analytics team to collect, parse, transform, manage very large scale datasets to generate insights. Develop

sustainable data solutions to enable analytics and implementation of insights.

2. Identifies potential data solutions, translates data solutions into design specifications and code. Responsible

for writing complex programs, ad hoc queries, and reports using team procedures and tool selection guidelines.

Ensures that all code is developed in a well-structured manner - includes sufficient documentation - and is easy

to maintain and reuse. Uses latest technologies to manage expanding external / internal, structured /

unstructured data sources.

3. Elevates complex technical issues to IT partners, including architects and vendors. Resolves technical

problems discovered by testers and internal clients. Responds to and resolves technical issues in a timely

manner. Researches issues and performs root cause analysis.

4. Understands how to apply technologies to solve big data challenges to support analytics needs. Develops and

applies extensive knowledge in different programming languages and databases, stays abreast with latest

industry / technology development for data solutions.

5. Develops deep expertise on client's data environment, new data sources, big data technology and

solutions and industry trends. Partners with internal clients to enhance understanding of business functions and

informational needs.

6. Partners closely with other technical leads, including advanced analytics teams, marketing technology group,

IT, and business clients to develop and implement appropriate data solutions for business problems and their

implications. Evaluates the impacts of solutions on own/shared technologies and effectively persuades and

influences others on ideas.

7. Participates in design, code, and test inspections throughout product life cycle for data solutions. Participates

as a technical consultant at other project meetings.

8. Understands and enforces team development guidelines. Mentors and develops staff with less experience.

Helps the team to resolve issues and conflict. Designs and conducts training sessions on tools and data sources

used by the team and self provisioners. Provides supporting documentation to team members and business

partners as needed.

9. Understands, complies with and enforces team policies and procedures, especially those for quality and

productivity standards that enable the team to meet established milestones. Understands, complies with and

enforces all Information Security policies and procedures, and verifies deliverables meet Information Security

requirements. Abides by Risk Controls as defined in the team CAF Documentation.


Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

easy apply

get jobs in your inbox.

sign up
{{returnMsg}}

related jobs


    Senior UX Designer

  • location: Malvern, PA
  • job type: Contract
  • salary: $35 - $52 per hour
  • date posted: 10/10/2018

    Senior Electrical Engineer

  • location: Philadelphia, PA
  • job type: Permanent
  • salary: $135,000 - $175,000 per year
  • date posted: 9/10/2018