Data Engineer

1 week ago

Bengaluru, Karnataka, India People's Growth HR Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year


Title: Data Engineer

Location: Bangalore, Karnataka

Timings: Full Time (As per company timings)

Notice Period: within 15 days or immediate joiner

Experience: 4+ Years

Interview round - 1st round + Assignment round + Final F2F round.

Basic Qualifications

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Prior professional, non-internship experience in software development, specifically within product startup environments.
  • Proven experience as a Data Engineer with expertise in ETL techniques is a MUST
  • Strong programming skills in languages such as Python, Java, or Scala.
  • Skillset to scrape and transform data off of the publicly available web sources
  • Experience with cloud-based data platforms (e.g., AWS, Azure, GCP).
  • Proficiency in SQL and experience working with relational and non-relational databases.
  • Knowledge of data warehousing concepts and architectures.
  • Familiarity with big data technologies such as Hadoop, Spark, and Kafka.
  • Experience with data modeling tools and techniques.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.

Preferred Qualifications

  • Master's degree or equivalent in Computer Science/ Data Science
  • Knowledge of data streaming and real-time processing.
  • Familiarity with data governance and security best practices.

Responsibilities:

Outline the primary responsibilities and tasks the candidate is expected to perform.

About the role

As a Data Engineer for our Data Science team, you will play a critical role in helping the team to enrich and maintain the central repository of datasets which is leveraged for carrying out advanced data analytics and machine learning techniques to extract actionable insights from financial and market data. You will work closely with cross-functional teams to develop and implement robust data pipelines that will automate the updation of data in our cloud-based repository in a ready to use form thereby increasing data accessibility for the entire organization.

Key Responsibilities:

ETL Development:

  • Design, develop, and maintain efficient ETL processes for multi-scale data sets.
  • Implement and optimize data transformation and validation processes to ensure data accuracy and consistency.
  • Collaborate with cross-functional teams to understand data requirements and business logic.

Data Pipeline Architecture:

  • Architect, build and maintain scalable and high-performance data pipelines
  • Evaluate and implement new technologies to enhance data pipeline efficiency and reliability
  • Pipelines for extracting data through scraping for ad-hoc sector specific datasets

Data Modelling:

  • Develop and implement data models to support analytics and reporting needs.
  • Optimize database structures for performance and scalability.

Data Quality and Governance:

  • Implement data quality checks and governance processes to ensure data integrity.
  • Collaborate with stakeholders to define and enforce data quality standards.

Documentation and Communication:

  • Document ETL processes, data models, and other relevant information.
  • Communicate complex technical concepts to non-technical stakeholders effectively.

Cross-functional collaboration:

  • Collaborate internally with the Quant team and developers to lay and optimize the data pipelines and externally with the stakeholders to understand the business requirements for the enrichment of the cloud database

  • Data Entry Operator

    2 weeks ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...

  • Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    Build scalable data pipelines from structured and unstructured sources Design ontologies that model business entities, relationships, and process flows Collaborate with domain SMEs and ML engineers to structure agent inputs and outputs Implement transformation, validation, and enrichment logic across diverse datasets Maintain and optimize cloud data...

  • Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....

  • Technical Lead- Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Data & AI Engineer Lead

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Framework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...

  • Data Engineer

    16 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Req ID: 343998NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Sr ETL Developer (Architect) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). "Job...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job Duties:Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix...

  • Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA North America Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - DBT to join our team in Bangalore, Karnātaka (IN-KA), India (IN)."Job Duties: We are seeking an Engineer to...

  • Sr Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    At least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution. Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must. Complete development, configuration, test cases and unit testing Perform code reviews and ensure standards...