Lead Software Engineer Data Engineering AWS Data bricks

4 days ago

Hyderabad, Telangana, India JPMorganChase Full time ₹ 20,00,000 - ₹ 25,00,000 per year

JOB DESCRIPTION

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.

As a Lead Software Engineer at JPMorgan Chase within Corporate Technology, you play a vital role in an agile team dedicated to enhancing, building, and delivering reliable, market-leading technology products in a secure, stable, and scalable manner. As a key technical contributor, you are tasked with implementing essential technology solutions across diverse technical domains, supporting various business functions to achieve the firm's strategic goals.

Job responsibilities

  • Develop appropriate level designs and ensure consensus from peers where necessary.
  • Collaborate with software engineers and cross-functional teams to design and implement deployment strategies using AWS Cloud and Databricks pipelines.
  • Work with software engineers and teams to design, develop, test, and implement solutions within applications.
  • Engage with technical experts, key stakeholders, and team members to resolve complex problems effectively.
  • Understand leadership objectives and proactively address issues before they impact customers.
  • Design, develop, and maintain robust data pipelines to ingest, process, and store large volumes of data from various sources.
  • Implement ETL (Extract, Transform, Load) processes to ensure data quality and integrity using tools like Apache Spark and PySpark.
  • Monitor and optimize the performance of data systems and pipelines.
  • Implement best practices for data storage, retrieval, and processing
  • Maintain comprehensive documentation of data systems, processes, and workflows.
  • Ensure compliance with data governance and security policies

Required qualifications, capabilities, and skills

  • Formal training or certification on software engineering concepts and 5+ years applied experience
  • Formal training or certification in AWS/Databricks with 10+ years of applied experience.
  • Expertise in programming languages such as Python and PySpark.
  • 10+ years of professional experience in designing and implementing data pipelines in a cloud environment.
  • Proficient in design, architecture, and development using AWS Services, Databricks, Spark, Snowflake, etc.
  • Experience with continuous integration and continuous delivery tools like Jenkins, GitLab, or Terraform.
  • Familiarity with container and container orchestration technologies such as ECS, Kubernetes, and Docker.
  • Ability to troubleshoot common Big Data and Cloud technologies and issues.
  • Practical cloud native experience

Preferred qualifications, capabilities, and skills

  • 5+ years of experience in leading and developing data solutions in the AWS cloud.
  • 10+ years of experience in building, implementing, and managing data pipelines using Databricks on Spark or similar cloud technologies

ABOUT US

  • Sr/ Lead AWS Data Engineer with Bricks@ Pune, Chennai&Hyd

    4 days ago

    Hyderabad, Telangana, India Innovatz Global Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Role: SeniorDataEngineer/ LeadLocation: Hyderabad/ Pune/ ChennaiDuration: Full timeJob Description:Strong tech competencies in AWS,Databricks and Python, SQLa. Must Have : Hands-on experience in Python and Advance SQLi. AWS services likes s3, lambda, IAM, RDS, cloudwatch. Strong concepts also expected.ii. Good Python knowledge with understanding...

  • Big Data QA/Test Engineer

    2 days ago

    Hyderabad, Telangana, India deltaclass technology solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role : Bigdata QA Test Engineer Exp : 6+Yrs Notice :Immediate to 15 Days Location:Hyderabad (Hybrid) Big Data QA/Test engineer – 3 Openings Hyderabad or Chennai (Hybrid) Big Data QA/Test Engineer AWS + Data-bricks + Big Data + Python + DevOps Big Data QA/Test Engineer AWS + Data-bricks + Big Data + Python + DevOps Big Data QA/Test Engineer AWS +...

  • Big Data QA/Test Engineer

    2 days ago

    Hyderabad, Telangana, India deltaclass technology solutions Full time ₹ 10,00,000 - ₹ 15,00,000 per year

    Currently we are looking for Bigdata QA test Engineer. Responsibilities Role : Bigdata QA Test Engineer Exp : 6+Yrs Notice :Immediate to 15 Days Location:Hyderabad (Hybrid) Big Data QA/Test engineer – 3 Openings Hyderabad or Chennai (Hybrid) Big Data QA/Test Engineer AWS + Data-bricks + Big Data + Python + DevOps Big Data QA/Test Engineer AWS +...

  • Data bricks Engineer

    2 weeks ago

    Hyderabad, Telangana, India CALTEK Solutions Inc. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Company DescriptionCALTEK Solutions Inc. is a leading provider of high-quality, results-driven IT services and consulting, founded in 2013. Headquartered in Fremont, CA, with business operations in Canada and India, CALTEK Solutions Inc. offers software development, data analytics, and management services. Our primary client sectors include Software,...

  • Azure Data Engineer

    2 days ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Data Engineer Lead

    2 weeks ago

    Hyderabad, Telangana, India Sonata Software Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    About Sonata SoftwareIn today's market, we observe a distinct duality in technology adoption. On one front, clients are keenly focused on cost containment, while on the other, there is a strong drive to modernize their digital storefronts, aiming to appeal to both consumers and B2B customers alike.As a leading Modernization Engineering company, we aim to...

  • AWS Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Zorba AI Full time ₹ 1,00,00,000 - ₹ 2,50,00,000 per year

    Senior AWS Data Engineer (PySpark & Python) — On-site, IndiaIndustry & Sector:Leading IT services & cloud data engineering sector focused on end-to-end data platforms, analytics, and enterprise-scale ETL/ELT solutions. We deliver production-grade data pipelines, real-time streaming, and analytics integrations for large enterprise customers across finance,...

  • AWS Cloud DevOps engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Req ID: 337989NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Cloud DevOps engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Experience with various AWS...

  • Azure Data Engineer With Snowflake

    4 days ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Data bricks

    2 weeks ago

    Hyderabad, Telangana, India Accurate Consulting Group Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Title:Senior Data Engineer – Databricks & PySparkLocation:HyderabadExperience:5+ YearsEmployment Type:Full-TimeRole OverviewWe're looking for a seasoned Data Engineer with deep expertise inDatabricks,PySpark, andcloud-native data pipelines. This role is ideal for someone who thrives in building scalable, secure, and governed data platforms while...