Data Engineer

4 days ago

Bengaluru, Karnataka, India LeadSquared Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Job Summary:

We are seeking a highly skilled and motivated Data Engineer to design, develop, and optimize our critical data infrastructure. You will play a pivotal role in building scalable batch and real-time data pipelines, ensuring data quality, and collaborating with cross-functional teams to deliver impactful data solutions. If you are passionate about data, possess strong technical skills, and thrive in a collaborative environment, we encourage you to apply.

Responsibilities:

  • Design, implement, and optimize robust batch and real-time data pipelines using technologies such as Spark, Python, and Airflow.
  • Leverage AWS native tools (e.g., S3, EMR, Glue) effectively to build and manage scalable data solutions.
  • Collaborate cross-functionally with data scientists, data analysts, product managers, and engineering teams to gather requirements, deliver high-quality data solutions, and ensure overall project success.
  • Lead initiatives focused on enhancing data quality, establishing data governance frameworks, implementing robust security measures, and setting up comprehensive data monitoring systems.
  • Evaluate, recommend, and integrate various cloud, big data, and DataOps tools, including SQL/NoSQL databases, streaming systems, workflow orchestration platforms, and observability tools.

Required Qualifications:

  • 2+ years of practical experience in data pipeline development, encompassing both batch and streaming processes.
  • Advanced knowledge and hands-on experience with Spark, Python, and SQL.
  • Proven expertise in designing and implementing ETL/ELT processes.
  • Strong practical experience with AWS (specifically EMR, S3, Glue) or other major cloud platforms (e.g., Azure, GCP).
  • Solid understanding and experience with data modeling, data warehousing concepts, and metadata management.
  • Demonstrated problem-solving abilities, strong analytical skills, and a highly collaborative mindset.

Preferred Qualifications:

  • Experience with CI/CD pipelines and MLOps lifecycle.
  • Exposure to NoSQL databases, data lake architectures, or streaming technologies (e.g., Kafka, Kinesis).
  • Experience utilizing API tools such as Postman and Swagger.
  • Awareness and understanding of data security, privacy, and compliance best practices.

  • Data Entry Operator

    1 week ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Data Engineer

    6 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...

  • Data Engineer

    12 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    Build scalable data pipelines from structured and unstructured sources Design ontologies that model business entities, relationships, and process flows Collaborate with domain SMEs and ML engineers to structure agent inputs and outputs Implement transformation, validation, and enrichment logic across diverse datasets Maintain and optimize cloud data...

  • Data Engineer

    8 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....

  • Technical Lead- Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Data & AI Engineer Lead

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Framework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...

  • Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 338632NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 338630NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job Duties:Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix...

  • Data Engineer

    10 hours ago

    Bengaluru, Karnataka, India NTT DATA North America Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - DBT to join our team in Bangalore, Karnātaka (IN-KA), India (IN)."Job Duties: We are seeking an Engineer to...