Data Engineer

4 days ago

Bangalore, India People Prime Worldwide Full time

About Client:

Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate innovation. It partners with major firms in banking, healthcare, telecom, and media.

Our Client is known for combining deep industry expertise with agile development practices, enabling scalable and cost-effective digital transformation. The company operates in over 50 locations across more than 25 countries, has delivery centers in Asia, Europe, and North America and is backed by Baring Private Equity Asia.

Job Title: Pyspark DataBrick Engineer

Skills : Pyspark,DataBrick,Sql,Aws

Job Locations: Hyderabad, Bengaluru, Chennai, Pune

Experience: 4 - 8 Years

Education Qualification : Any Graduation

Work Mode: Hybrid

Employment Type: Contract

Notice Period: Immediate - 15 Days

Interview Mode: 2 Rounds of Technical Interview

Skill- Pyspark + Databrick +AWS + SQL

  • Key Responsibilities:
  • Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates, and schema evolution. Optimize data processing workflows for performance, scalability, and cost efficiency. Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets. Implement data quality checks, validation routines, and logging mechanisms. Monitor and debug production jobs using Databricks jobs, notebooks, and clusters. Ensure security, privacy, and compliance standards are met throughout the data lifecycle. Provide guidance and mentorship to junior team members.
  • Required Skills & Qualifications:
  • 5 to 7 years of experience in Big Data development. Hands-on experience with Databricks (including Workflows, Notebooks, Delta Live Tables, Unity Catalog). Strong programming skills in PySpark and/or Scala. Solid understanding of Delta Lake architecture. Proficient in SQL for data analysis and transformation. Experience with cloud platforms such as Azure (Azure Data Lake, Data Factory, Synapse) or AWS (S3, Glue, Redshift). Familiarity with CI/CD for Databricks deployments (e.g., using GitHub Actions, Azure DevOps). Knowledge of data governance, cataloguing, and security best practices. Experience working in an Agile/Scrum environment.
  • Preferred Skills:
  • Experience with Databricks Unity Catalog and Delta Live Tables. Exposure to machine learning workflows in Databricks. Experience with Apache Airflow, Kafka, or other orchestration/messaging tools. Certifications such as Databricks Certified Data Engineer Associate/Professional, Azure, or AWS certification.

Intrested Candidates share your CV to

  • Data Engineer

    7 days ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 324638NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Key Responsibilities Design and implement...

  • Lead Data Engineer

    6 days ago

    bangalore, India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Data Senior Engineer

    7 days ago

    HAL Bangalore Airport, India NTT DATA North America Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience in a...

  • Data Engineer

    7 days ago

    HAL Bangalore Airport, India NTT DATA North America Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    7 days ago

    HAL Bangalore Airport, India NTT DATA North America Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key Responsibilities Data...

  • Sr. Data Science

    5 days ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 312452NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Sr Data Science AIML GenAI Lead Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Job Duties...

  • Mid Data Science

    5 days ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 312426NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Mid Data Science AIML GenAI Lead Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Job Duties...

  • Azure Data Migration

    5 days ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 317094NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Azure Data Migration to join our team in Bangalore Karnxc4x81taka IN-KA India IN Job Duties Primary Responsibility...

  • Digital Engineering Staff Engineer

    7 days ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 310926NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Staff Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Title Business...

  • Data Engineer

    6 days ago

    bangalore, India Insight Global Full time

    JOB DESCRIPTIONInsight Global is seeking a junior Data Engineer to join a large retail client remotely based in India. The Junior Data Engineer will support the identification and implementation of complex data, monitor and troubleshoot data engineering incidents and more. The Junior-level Data Engineer is expected to have 3+ years of experience. As a Data...