hadoop/scala developer.

job summary: Description: AWS Cloud Engineer-iGrid Core Technical Skills: - 3+ years of AWS experience - Hands-on Experience with AWS services - S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, Step Functions - Extensive Experience with EMR databases such as Glue Catalog, Lake Formation, Redshift, DynamoDB and Aurora - Required Tools and Languages - Python, Spark, PySpark and Pandas - Infrastructure as Code technology - Terraform/CloudFormation - Experience with Secrets Management Platform like Vault and AWS Secrets manager - Experience with DevOps pipeline (CI/CD) - Bitbucket; Concourse - Experience with RDBMS platforms and Robust proficiency with SQL - Deep knowledge of IAM roles and Policies - Experience using AWS monitoring services like CloudWatch, CloudTrail ad CloudWatch events - Experience with AWS workflow orchestration tool like Airflow or Step Functions - Experience with Kafka/Messaging preferably Confluent Kafka - Experience with Event Driven Architecture AWS Cloud Engineer Additional Technical Skills (nice to have, but not required for the role) - Experience with native AWS technologies for data and analytics such as Kinesis, OpenSearch - Databases - Document DB, Mongo DB - Hadoop platform (Hive; HBase; Druid) - Java, Scala, Node JS - Workflow Automation - Experience transitioning on premise big data platforms into cloud-based platforms such as AWS - Robust Background in Kubernetes, Distributed Systems, Microservice architecture and containers - Experience with Rest APIs and API gateway - Deep understanding of networking DNS, TCP/IP and VPN Core Experience and Abilities: - Ability to perform hands on development and peer review for certain components / tech stack on the product o Standing up of development instances and migration path (with required security, access/roles) o Develop components and related processes (e.g. data pipelines and associated ETL processes, workflows) o Lead implementation of integrated data quality framework o Ensures optimal framework design and load testing scope to optimize performance (specifically for Big Data) o Supports data scientist with test and validation of models o Performs impact analysis and identifies risk to design changes o Ability to build new data pipelines, identify existing data gaps and provide automated solutions to deliver analytical capabilities and enriched data to applications o Ensures Test Driven development - 3+ years of Experience leading teams to deliver complex products - Robust technical skills and communication skills - Robust skills with business stakeholder interactions - Robust solutioning and architecture skills - 5+ years of Experience building real time data ingestion streams (event driven) - Ensure data security and permissions solutions, including data encryption, user access controls and logging   location: Charlotte, North Carolina job type: Contract salary: $68 - 78 per hour work hours: 8am to 5pm education: Bachelors   responsibilities: - Provides technical direction, guides the team on key technical aspects and responsible for product tech delivery o Lead the Design, Build, Test and Deployment of components ? Where applicable in collaboration with Lead Developers (Data Engineer, Software Engineer, Data Scientist, Technical Test Lead) o Understand requirements / use case to outline technical scope and lead delivery of technical solution o Confirm required developers and skillsets specific to product o Provides leadership, direction, peer review and accountability to developers on the product (key responsibility) o Works closely with the Product Owner to align on delivery goals and timing o Assists Product Owner with prioritizing and managing team backlog o Collaborates with Data and Solution architects on key technical decisions ? The architecture and design to deliver the requirements and functionality   qualifications: Experience level: ExperiencedMinimum 3 years of experienceEducation: Bachelors  skills: AWSCloudJavaScalanodeJS Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status. For certain assignments, Covid-19 vaccination and/or testing may be required by Randstad's client or applicable federal mandate, subject to approved medical or religious accommodations. Carefully review the job posting for details on vaccine/testing requirements or ask your Randstad representative for more information.

job summary: Description: Enterprise Capital Management technology team is looking for a individual performer with ability to work in a fast paced agile environment. The objective of our team is to ensure client and its subsidiaries are compliant from a regulatory capital reporting perspective under the Basel rules in a new stable, scalable and sustainable capital reporting and analysis platform. The project elaborates requirements for data sourcing elements for calculating risk weighted assets, details business logic for computing these financial elements and defines process-flow and formulas for generating Basel rules-based capital ratios. These requirements are captured for various entities at Client including financial holding company and related depository institution entities (financial).This role will be responsible for hands-on application development to support the current and target process, as well as partnering with the multiple Technology teams to implement the target architecture and migration to strategic platform. Typically requires 10+ years of applicable experience. Required Skills: 8+ years of experience in Python development experience is a must4+ years of experience in big data technologies like Spark, Hadoop2+ years of SQL programming experience preferably with databases such as Oracle ExadataKnowledge of performance tuning data intensive applicationsExpertise in performance profiling, ability to identify performance improvements and memory optimizationscoding, debugging, and analytical skillsExperience in large scale enterprise application design and implementationCreative individual with a track record of working on and implementing innovative tech based solutionsExcellent communication skills Desired Skills: Degree from outstanding universityBackground in capital calculationsBS/MS in Computer Science, Engineering, or any quantitative disciplineKnowledge and/or experience working within the Hadoop or other big data distributed ecosystemKnowledge of cloud computing or distributed computing2+ years of Java development is preferredExperience working with agile methodologies and SDLC processes would be preferred1+ years of UNIX scripting experience and unit test mock frameworks would be preferredExperience in Quartz (Internal financial platform) would be preferred but optional Primary Skill: Python   location: Charlotte, North Carolina job type: Contract salary: $55 - 65 per hour work hours: 9am to 5pm education: Bachelors   responsibilities: Enterprise Capital Management technology team is looking for a strong individual performer with ability to work in a fast paced agile environment. The objective of our team is to ensure client and its subsidiaries are compliant from a regulatory capital reporting perspective under the Basel rules in a new stable, scalable and sustainable capital reporting and analysis platform. The project elaborates requirements for data sourcing elements for calculating risk weighted assets, details business logic for computing these financial elements and defines process-flow and formulas for generating Basel rules-based capital ratios. These requirements are captured for various entities at Client including financial holding company and related depository institution entities (financial).This role will be responsible for hands-on application development to support the current and target process, as well as partnering with the multiple Technology teams to implement the target architecture and migration to strategic platform. Typically requires 10+ years of applicable experience.   qualifications: Experience level: ExperiencedMinimum 10 years of experienceEducation: Bachelors  skills: Python Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status. For certain assignments, Covid-19 vaccination and/or testing may be required by Randstad's client or applicable federal mandate, subject to approved medical or religious accommodations. Carefully review the job posting for details on vaccine/testing requirements or ask your Randstad representative for more information.

job summary: AWS Tech Lead Core Technical Skills: - 5+ years of AWS experience - AWS services - S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, Step Functions - Experience with Kafka/Messaging preferably Confluent Kafka - Experience with EMR databases such as Glue Catalog, Lake Formation, Redshift, DynamoDB and Aurora - Tools and Languages - Python, Spark, PySpark and Pandas - Infrastructure as Code technology - Terraform/CloudFormation - Experience with Secrets Management Platform like Vault and AWS Secrets manager - Experience with Event Driven Architecture - DevOps pipeline (CI/CD); Bitbucket; Concourse - Experience with RDBMS platforms and Robust proficiency with SQL - Experience with Rest APIs and API gateway - Deep knowledge of IAM roles and Policies - Experience using AWS monitoring services like CloudWatch, CloudTrail ad CloudWatch events - Deep understanding of networking DNS, TCP/IP and VPN - Experience with AWS workflow orchestration tool like Airflow or Step Functions AWS Tech Lead Additional Technical Skills (nice to have, but not required for the role): - Experience with native AWS technologies for data and analytics such as Kinesis, OpenSearch - Databases - Document DB, Mongo DB - Hadoop platform (Hive; HBase; Druid) - Java, Scala, Node JS - Workflow Automation - Experience transitioning on premise big data platforms into cloud-based platforms such as AWS - Robust Background in Kubernetes, Distributed Systems, Microservice architecture and containers Core Experience and Abilities: - Ability to perform hands on development and peer review for certain components / tech stack on the product o Standing up of development instances and migration path (with required security, access/roles) o Develop components and related processes (e.g. data pipelines and associated ETL processes, workflows) o Lead implementation of integrated data quality framework o Ensures optimal framework design and load testing scope to optimize performance (specifically for Big Data) o Supports data scientist with test and validation of models o Performs impact analysis and identifies risk to design changes o Ability to build new data pipelines, identify existing data gaps and provide automated solutions to deliver analytical capabilities and enriched data to applications o Ensures Test Driven development - 5+ years of Experience leading teams to deliver complex products - Robust technical skills and communication skills - Robust skills with business stakeholder interactions - Robust solutioning and architecture skills - 5+ years of Experience building real time data ingestion streams (event driven) - Ensure data security and permissions solutions, including data encryption, user access controls and logging   location: Charlotte, North Carolina job type: Contract salary: $61 - 71 per hour work hours: 8am to 5pm education: Bachelors   responsibilities: - Provides technical direction, guides the team on key technical aspects and responsible for product tech delivery o Lead the Design, Build, Test and Deployment of components - Where applicable in collaboration with Lead Developers (Data Engineer, Software Engineer, Data Scientist, Technical Test Lead) o Understand requirements / use case to outline technical scope and lead delivery of technical solution o Confirm required developers and skillsets specific to product o Provides leadership, direction, peer review and accountability to developers on the product (key responsibility) o Works closely with the Product Owner to align on delivery goals and timing o Assists Product Owner with prioritizing and managing team backlog o Collaborates with Data and Solution architects on key technical decisions - The architecture and design to deliver the requirements and functionality   qualifications: Experience level: ExperiencedMinimum 5 years of experienceEducation: Bachelors  skills: AWSKafkaPythonSparkTerraform/CloudFormation Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status. For certain assignments, Covid-19 vaccination and/or testing may be required by Randstad's client or applicable federal mandate, subject to approved medical or religious accommodations. Carefully review the job posting for details on vaccine/testing requirements or ask your Randstad representative for more information.