Job Description:
- Infrastructure Information Services is looking for top talent to design and build best-in-class Data Management and Integration Services capability over Infrastructure/ITSM data using Hadoop Architecture.
- The Data Engineer will innovate and transform the systems integration landscape for the Technology Infrastructure organization, while following industry best practices and providing capability maturity in support of Enterprise Data Management standards.
- The ideal candidate is an expert in Data Warehousing and Master Data Management Design and Development.
- Candidate should have a understanding of data management concepts and applied DW/MDM development of DB-level routines and objects.
- Candidate should have experience in migrating traditional Relational Database Management System (RDBMS) to a Hadoop based architecture. In addition have hands on experience developing in many of the Apache Hadoop based tools.
- It involves hands-on development and support of integrations with multiple systems and ensuring accuracy and quality of data by implementing business and technical reconciliations. Candidate needs to be able to understand macro level requirements and convert them into actionable tasks to deliver a technically sound product. Candidate should be able to work in teams in a collaborative manner.
- Analyze current RDBMS Master Data Management platform including orchestrations, workflows, transformations and help designing a scalable platform based on Hadoop for structured and semi-structure big data.
- Ability to reengineer traditional database system and stored procedures using Big Data services
- Accomplished development experience using Spark and Spark SQL
- Expert level skills for evaluating, developing and performance tuning existing HIVE Managed Tables and PySpark implementation.
- Ability to manage multiple priorities
- 10+ years of total IT experience
- At least 5 years of experience developing for Data Warehousing, Data Marts, and/or Master Data Management
- Deep experience on Hadoop including Python, Spark, HIVE, HBase and HDFS with an emphasis on performance tuning and architecture. E.g. partitioning, bucketing and parquet, flat file
- Programming experience Python, PySpark, Spark SQL.
- Exposure to Relational Database Management Systems using Oracle, DB2 or SQL Server
- Possesses and demonstrates deep knowledge of the Hadoop Ecosystem
- Experienced exposure to Hadoop ecosystem including but not limited to: HDFS, MapReduce, Spark, Sqoop, Oozie, Kafka, Hive
- Object oriented programming concepts
- Expert SQL skills
- Experience in SDLC and best practices for development
- Ability to work against mid-level design documentation, take it to a low-level design, and deliver a solution that meets the success criteria
- Knowledge of packaging and promotion practices for maintaining code in development, test, and production
location: Charlotte, North Carolina
job type: Contract
salary: $60 - 70 per hour
work hours: 9am to 5pm
education: Bachelors
responsibilities:
- Analyze current RDBMS Master Data Management platform including orchestrations, workflows, transformations and help designing a scalable platform based on Hadoop for structured and semi-structure big data.
- Ability to reengineer traditional database system and stored procedures using Big Data services
- Accomplished development experience using Spark and Spark SQL
- Expert level skills for evaluating, developing and performance tuning existing HIVE Managed Tables and PySpark implementation.
- Ability to manage multiple priorities
qualifications:
- Experience level: Experienced
- Minimum 10 years of experience
- Education: Bachelors
skills:
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
At Randstad, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.
Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad offers a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).
For certain assignments, Covid-19 vaccination and/or testing may be required by Randstad's client or applicable federal mandate, subject to approved medical or religious accommodations. Carefully review the job posting for details on vaccine/testing requirements or ask your Randstad representative for more information.
