Data Engineer

2 weeks ago

Bengaluru, India OMEGA HIRES CONSULTANCY Full time

Job Description :


Key Responsibilities :


- Design, develop, and maintain robust, scalable, and efficient data pipelines on GCP (Google Cloud Platform).

- Implement ETL (Extract, Transform, Load) processes and ensure data quality and consistency across all data sources.

- Work with GCP data services such as BigQuery, Cloud Storage, Dataflow, Dataproc, Pub/Sub, and Composer to manage and process large volumes of data.

- Develop and optimize SQL queries and data models to support business analytics and reporting needs.

- Integrate data from various sources, including internal databases, third-party data, and APIs.

- Collaborate with data scientists and business stakeholders to identify data needs and deliver actionable insights.

- Monitor and troubleshoot data pipeline performance, ensuring data is processed and delivered on time.

- Apply best practices for data security, including data encryption, access control, and audit logging in GCP.

- Continuously evaluate and improve data infrastructure, ensuring high availability, scalability, and reliability.

- Automate data operations and reporting using tools like Cloud Functions, Cloud Run, and others.

- Stay up to date with emerging GCP technologies, data engineering trends, and best Qualifications :


- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.

- Proven experience in data engineering or a similar role with expertise in Google Cloud Platform (GCP).

- Strong proficiency in SQL and experience with relational databases (BigQuery, Cloud SQL, etc.).

- Experience working with GCP data services : BigQuery, Cloud Storage, Dataflow, Pub/Sub, Dataproc, and Cloud Composer.

- Knowledge of data modeling, data warehousing concepts, and ETL processes.

- Familiarity with programming languages like Python, Java, or Scala.

- Experience with version control systems (e.g., Git) and agile development methodologies.

- Understanding of data security best practices in cloud environments.

- Strong problem-solving and analytical skills.

- Excellent communication and collaboration skills.


(ref:hirist.tech)

  • Data Engineer

    7 hours ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Data Entry Operator

    4 days ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...

  • Data Engineer

    1 week ago

    Bengaluru, India NTT DATA, Inc. Full time

    Req ID: We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN). "Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack...

  • Technical Lead- Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Data Senior Engineer

    6 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...

  • Data Engineer

    1 week ago

    Bengaluru, India NTT DATA Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    1 week ago

    Bengaluru, India NTT DATA Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key ResponsibilitiesData...

  • Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job Duties:Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix...

  • Senior, Data Engineer

    1 week ago

    Bengaluru, India NTT DATA Full time

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive. Your day at NTT DATAThe Manager,...