SW Architect Data Platform

  • location: Boston, MA
  • type: Permanent
  • salary: $150,000 - $250,000 per year

job description

SW Architect Data Platform

job summary:
Role & Responsibilities

  • You will architect, design and build critical Data Platform services.
  • You will build data capture and collection services using the latest technologies.
  • You will design and develop core software modules used to build real-time and batch data processing.
  • You will build Stream processing software to ingest, process, enrich and store various data assets.
  • You will work with all aspects of data processing with a keen eye for data quality, data integrity and data availability.
  • You will evaluate/implement new open source and cloud native tools and technologies, as needed.
  • You will participate in the on-call rotation supporting the data platform.
About You

  • You have a BS/MS in Computer Science or a related technical field
  • You have a strong software engineering background and a proven track record of delivering high quality products at scale
  • You must currently be in a hands-on role. Must have strong coding skills(Java or Scala, Python & Go would be a plus) and be able to design systems that meet the business needs.
  • You must have a solid understanding of high performance data capture and collection systems, design of APIs around these systems. Design for reliable delivery of data.
  • Good understanding of how Hadoop/Spark/Presto cluster works
  • Different storage formats - Parquet/ORC
  • Performance optimizations on Hadoop workloads
  • Query Access on Storage Engines such Hadoop/S3
  • Strong Knowledge on AWS EMR ecosystem
  • You have 5+ years of experience in building high performance data ingestion software and solving for concurrency, latency and efficiency.
  • Excellent interpersonal, technical and communication skills
  • Ability to prioritize multiple tasks in a fast-paced environment
Nice to have

  • Experience working with Public cloud (GCP/AWS etc).
 
location: Boston, Massachusetts
job type: Permanent
salary: $150,000 - 250,000 per year
work hours: 8am to 5pm
education: Bachelors
 
responsibilities:
  • You will architect, design and build critical Data Platform services.
  • You will build data capture and collection services using the latest technologies.
  • You will design and develop core software modules used to build real-time and batch data processing.
  • You will build Stream processing software to ingest, process, enrich and store various data assets.
  • You will work with all aspects of data processing with a keen eye for data quality, data integrity and data availability.
  • You will evaluate/implement new open source and cloud native tools and technologies, as needed.
  • You will participate in the on-call rotation supporting the data platform.
 
qualifications:
  • Experience level: Experienced
  • Education: Bachelors
 
skills:
  • JAVA DEVELOPER (5 years of experience is required)
  • Python (4 years of experience is required)
  • Api
  • Hadoop (4 years of experience is required)
  • AWS (4 years of experience is required)

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

get jobs in your inbox.

sign up
{{returnMsg}}

related jobs


    SAAS Software Engineer/Lead

  • location: Lexington, MA (remote)
  • job type: Permanent
  • salary: $155,000 - $185,000 per year
  • date posted: 7/13/2021