Lead Software Engineer Data Engineering Aws Data Bricks

3 weeks ago

Hyderabad Telangana, India JPMorgan Chase Full time

Job Category Software Engineering We have an opportunity to impact your career and provide an adventure where you can push the limits of what s possible As a Lead Software Engineer at JPMorgan Chase within Corporate Technology you play a vital role in an agile team dedicated to enhancing building and delivering reliable market-leading technology products in a secure stable and scalable manner As a key technical contributor you are tasked with implementing essential technology solutions across diverse technical domains supporting various business functions to achieve the firm s strategic goals Job responsibilities Develop appropriate level designs and ensure consensus from peers where necessary Collaborate with software engineers and cross-functional teams to design and implement deployment strategies using AWS Cloud and Databricks pipelines Work with software engineers and teams to design develop test and implement solutions within applications Engage with technical experts key stakeholders and team members to resolve complex problems effectively Understand leadership objectives and proactively address issues before they impact customers Design develop and maintain robust data pipelines to ingest process and store large volumes of data from various sources Implement ETL Extract Transform Load processes to ensure data quality and integrity using tools like Apache Spark and PySpark Monitor and optimize the performance of data systems and pipelines Implement best practices for data storage retrieval and processing Maintain comprehensive documentation of data systems processes and workflows Ensure compliance with data governance and security policies Required qualifications capabilities and skills Formal training or certification on software engineering concepts and 5 years applied experience Formal training or certification in AWS Databricks with 10 years of applied experience Expertise in programming languages such as Python and PySpark 10 years of professional experience in designing and implementing data pipelines in a cloud environment Proficient in design architecture and development using AWS Services Databricks Spark Snowflake etc Experience with continuous integration and continuous delivery tools like Jenkins GitLab or Terraform Familiarity with container and container orchestration technologies such as ECS Kubernetes and Docker Ability to troubleshoot common Big Data and Cloud technologies and issues Practical cloud native experience Preferred qualifications capabilities and skills 5 years of experience in leading and developing data solutions in the AWS cloud 10 years of experience in building implementing and managing data pipelines using Databricks on Spark or similar cloud technologies

  • Lead Software Engineer Data Engineering Aws Data Bricks

    4 weeks ago

    Hyderabad, Telangana, India JPMorgan Chase Full time

    Job Category Software Engineering We have an opportunity to impact your career and provide an adventure where you can push the limits of what s possible As a Lead Software Engineer at JPMorgan Chase within Corporate Technology you play a vital role in an agile team dedicated to enhancing building and delivering reliable market-leading technology products in...

  • Aws Lead Engineer

    5 days ago

    Hyderabad, Telangana, India NTT DATA Full time

    Req ID 304644 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a AWS Lead Engineer to join our team in Hyderabad Telangana IN-TG India IN Basic Qualifications 3 years experience in AWS Infra...

  • Data Bricks

    1 week ago

    Bengaluru, Chennai, Hyderabad, India Tata Consultancy Services Full time ₹ 35,00,000 - ₹ 70,00,000 per year

    DATA BRICKS:Project Overview: As part of this data engineering project, enabling & supporting the data pipelines with Thermo fisher standards.Role Scope / Deliverables: Create new data pipelines in databricks. Support existing data pipelines in databricks. Create DAG setup in in airflow. Resolve day to day job failurs/performance issues. Key Skills: •...

  • Data bricks Engineer

    1 week ago

    Hyderabad, Telangana, India CALTEK Solutions Inc. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Company DescriptionCALTEK Solutions Inc. is a leading provider of high-quality, results-driven IT services and consulting, founded in 2013. Headquartered in Fremont, CA, with business operations in Canada and India, CALTEK Solutions Inc. offers software development, data analytics, and management services. Our primary client sectors include Software,...

  • Data Engineer

    7 hours ago

    Bengaluru, Chennai, Hyderabad, India Sonata Software Full time

    Hi,We are looking for Data Engineer.Exp: 7+ yrsSkills: Azure Data Factory, Data Brick, MS SQL Analysis Services, MS SQL Integration Services

  • Data Engineer

    2 weeks ago

    Hyderabad, Telangana, , India The Modern Data Company Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    About the role: Role Overview: The Data Engineer is responsible for building and maintaining data infrastructure that enables organizations to store, process, and analyze large volumes of data. This role focuses on developing robust batch and streaming data pipelines to create data products, derive insights, and support analytics initiatives. The engineer...

  • Data Engineer/Sr Data Engineer

    4 days ago

    Ahmedabad, Hyderabad, Navi Mumbai, India IT Company - Data Science & AI Services Full time

    Guarantee that Databricks best practices are appliedthroughout all projectsYour role will involve designing and building robust data pipelinedevelopment and deployment of innovative big data and AI applicationsadvanced data engineering techniques Required Candidate profileExpert-level proficiency in Spark Scala, Python, and PySpark. Knowledge of data...

  • Azure Data Bricks

    2 weeks ago

    Hyderabad, Telangana, India Source-right Full time

    **Position: Azure Data bricks (MT415FT RM 3698)** **Mandatory Skill**: Programming Languages: Proficient in Python, PyTest and PySpark with a strong understanding software engineering best practices. Oops Concept: Strong Knowledge of It. Cloud Computing: Utilize Azure cloud based data platforms, specifically leveraging Databricks and Delta Live Tables for...

  • Azure Data Engineer

    1 week ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India, Telangana Zemoso Technologies Full time

    Job Title: Data Engineer Experience: 5+ Years Location: Chennai/Hyderabad/Mumbai/Pune/Bangalore (Hybrid) Key Responsibilities: ● Python Proficiency: Demonstrate a strong command of Python programming language, actively contributing to the development and maintenance of data engineering solutions. ● Data Engineering Expertise: Set up and maintain...