Data Engineer

2 days ago

Bengaluru, Karnataka, India TCP Corps Full time ₹ 15,00,000 - ₹ 25,00,000 per year
Required Skills - Python, Pyspark, Azure Data Factory, SQL, Data Modelling
Overview: The Data Engineer (Azure) plays a crucial role in our organization, responsible for designing, developing, and maintaining scalable data pipelines for data ingestion, transformation, and storage on Azure cloud platform. This position is pivotal in ensuring the efficiency and reliability of data architecture and infrastructure, enabling data-driven decision-making across the organization.Key Responsibilities:
  • Design and develop Azure data solutions, including data lakes, data warehouses, and data integration services.
  • Implement and maintain ETL processes to ingest, cleanse, transform, and aggregate data from various sources.
  • Optimize data infrastructure for performance, scalability, and cost-effectiveness on Azure.
  • Collaborate with data scientists and analysts to understand data requirements and implement efficient data retrieval and storage mechanisms.
  • Develop and maintain data pipelines using Azure Data Factory, Databricks, or similar tools.
  • Ensure data security and compliance with industry regulations in all Azure data solutions.
  • Troubleshoot and resolve data-related issues, ensuring the stability of data pipelines and services.
  • Document data architecture, processes, and procedures for knowledge sharing and future reference.
  • Participate in the evaluation and implementation of new tools and technologies for data engineering on Azure.
  • Conduct performance tuning and optimization of Azure data solutions for improved efficiency.
Required Qualifications:
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Proven experience in designing, developing, and maintaining data solutions on Azure cloud platform.
  • Expertise in SQL programming for data manipulation, querying, and performance optimization.
  • Proficiency in programming languages such as Python, Java, or Scala for data processing and manipulation.
  • Hands-on experience with Azure services, including Azure Data Lake Storage, Azure Synapse Analytics, and Azure Data Factory.
  • Strong understanding of data modeling, data warehousing concepts, and ETL best practices.
  • Experience in building scalable and reliable data pipelines using Azure services and tools.
  • Good understanding of data security principles and best practices in Azure environments.
  • Excellent problem-solving and analytical skills with the ability to troubleshoot complex data issues.
  • Effective communication skills and the ability to work collaboratively in a team environment.
  • Relevant Azure certifications such as Azure Data Engineer Associate or Azure Solutions Architect are a plus.
  • Familiarity with DevOps practices and tools for continuous integration and deployment of data solutions on Azure is desirable.
  • Knowledge of agile methodologies and project management practices for successful delivery of data engineering projects.

  • Data Entry Operator

    4 days ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Sr. Data Engineer Data Science

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 342869NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Engineer Data Science to join our team in Bangalore, Karnātaka (IN-KA), India (IN). ...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from...

  • Technical Lead- Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Data & AI Engineer Lead

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Framework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    Req ID: 344005NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - ETL Developer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). "Job Duties: Design,...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Req ID: 343998NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Sr ETL Developer (Architect) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). "Job...

  • Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job Duties:Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix...