Data Engineer

2 weeks ago

Bengaluru, Karnataka, India Pradeepit Global Consulting Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Azure Databricks

Job Description: Data Engineer (Azure Databricks & PySpark)

Position: Data Engineer
Experience: 3 to 5 years
Primary Skills: Azure Databricks, PySpark, SQL
Secondary Skills: ADF (Azure Data Factory)
Location: Bengaluru/Hyderabad
Mode of Work: Hybrid
Notice Period: 0 to 30 Days

Key Responsibilities:

ETL Development & Data Processing:

  • Design, develop, and maintain ETL pipelines using Azure Databricks, PySpark, and ADF.
  • Extract, transform, and load data from multiple sources into Azure Data Lake Storage.
  • Optimize and fine-tune ETL workflows for performance and scalability.

SQL & Query Optimization:

  • Write complex SQL queries, joins, subqueries, and functions for data processing.
  • Perform SQL tuning and query optimization for improved efficiency.
  • Work with large datasets and ensure optimal data handling.

Azure Cloud Integration:

  • Implement data solutions using Azure technologies (Databricks, ADF, ADLS).
  • Work with batch and streaming data processing for real-time analytics (preferred).
  • Ensure data security, compliance, and reliability in cloud-based systems.

Collaboration & Problem-Solving:

  • Work closely with cross-functional teams to support data analytics and business intelligence initiatives.
  • Identify and resolve data-related issues proactively.
  • Provide insights and recommendations for improving ETL performance.
Required Skills & Qualifications:

3 to 5 years of experience in Azure Databricks, PySpark, and SQL.
Strong SQL skills complex joins, functions, procedures, query tuning.
Hands-on experience in ADF (Azure Data Factory) and Azure Data Lake Storage.
Ability to handle large datasets efficiently.
Experience in performance optimization of ETL workflows.
Good understanding of batch and streaming data processing (preferred).
Strong analytical and problem-solving skills.
Ability to work independently and take ownership of tasks.

Experience LevelMid Level

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from...

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Key Responsibilities -Data Management - Develop data mapping specifications and transformation rules Perform data cleansing, validation, and reconciliation activities Create and execute data conversion scripts and processes Document data...

  • Sr Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Req ID: 340286NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Data Engineer (Life and Annuity) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: At...

  • Senior Data Engineer cum Data Scientist

    7 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the RoleAs a Senior Data Engineer cum Data Scientist, you will be a key contributor to designing, developing, and operating advanced data architectures, pipelines, and analytics solutions within the Palantir ecosystemYou will leverage your deep expertise in Palantir Foundry and Gotham platforms, combined with strong AI capabilities, to solve complex...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA North America Full time

    Job DescriptionReq ID: 340517NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN).- Hands-on experience in...

  • Data Engineer Senior Consultant

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    Req ID: 341131NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Senior Consultant to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Location: | Experience:...

  • Data Visualization Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 1,04,000 - ₹ 13,08,780 per year

    Req ID: 340987NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Visualization Engineer - Power BI to join our team in Bangalore, Karnātaka (IN-KA), India (IN). "Job Duties: As...