Data Engineer

4 days ago

Bangalore, Karnataka, India Huquo Full time

Data Engineer will be responsible for designing, developing, and maintaining data pipelines . This role requires expertise in data engineering best practices, big data technologies. The ideal candidate will work closely with data scientists, analysts, and other stakeholders to ensure the availability, reliability, and efficiency of data systems, enabling data-driven decision-making across the organization.

Location : Bangalore - 3 Days a week client office.

Key Responsibilities :

Data Pipeline Development :

- Design, develop, and maintain scalable and efficient data pipelines.

- Implement data ingestion processes from various data sources (e.g., APIs, databases, file systems).

- Ensure data quality, integrity, and reliability throughout the data lifecycle.

Big Data Processing :

- Develop and manage large-scale data processing workflows using Apache Beam, Dataflow, and other big data technologies.

- Good experience on On-Prem to cloud Migration.


- At least 1or 2 end to end cloud migration project experience.

- Implement real-time data streaming solutions using any cloud platform ( preferable -GCP)

- Optimize data processing jobs for performance and cost.

Collaboration and Communication :

- Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.

- Communicate technical concepts effectively to both technical and non-technical stakeholders.

- Participate in agile development processes, including sprint planning, stand-ups, and retrospectives.

Data Management and Governance :

- Implement and maintain data governance practices, including data cataloging, metadata management, and data lineage.

- Ensure compliance with data security and privacy regulations.

- Monitor and manage data quality and consistency.

Qualifications :

Education : Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field.

Experience :

- Minimum of 5-10 years of experience in data engineering.

Technical Skills :

- Familiarity with big data technologies and frameworks (e.g., Apache Beam, Hadoop, Spark). Cloud migration expertise.

Key Competencies :

- Strong problem-solving skills and attention to detail.

- Excellent communication and teamwork skills.

- Ability to work in a fast-paced, dynamic environment.

- Self-motivated and able to work independently as well as part of a team.

- Continuous learning mindset and a passion for staying up-to-date with emerging technologies.

(ref:hirist.tech)

  • Aptus Data Labs

    1 month ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Description :We are seeking an experienced Snowflake Lead/Architect with expertise in AWS to join our dynamic team. As a Snowflake Lead/Architect, you will play a critical role in designing and implementing scalable data architectures using Snowflake within the AWS ecosystem. If you have a passion for cloud-based data warehousing and a strong understanding...

  • Aptus Data Labs

    4 weeks ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Description :We are seeking an experienced Snowflake Lead/Architect with expertise in AWS to join our dynamic team. As a Snowflake Lead/Architect, you will play a critical role in designing and implementing scalable data architectures using Snowflake within the AWS ecosystem. If you have a passion for cloud-based data warehousing and a strong understanding...

  • Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • Data Engineer

    1 month ago

    Bangalore, Karnataka, India VY Systems Pvt Ltd. Full time

    Job Description : The role described here is for a seasoned data engineer with 8 to 13 years of experience, showcasing proficiency across various aspects of data management and engineering. Let's delve deeper into each requirement :1. Data Engineering Experience :- Candidates should possess a solid foundation in data engineering, indicating a substantial...

  • Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India VY Systems Pvt Ltd. Full time

    Job Description : The role described here is for a seasoned data engineer with 8 to 13 years of experience, showcasing proficiency across various aspects of data management and engineering. Let's delve deeper into each requirement :1. Data Engineering Experience :- Candidates should possess a solid foundation in data engineering, indicating a substantial...

  • Data Engineer

    1 day ago

    Bangalore, Karnataka, India Addwiser Full time

    Job Title : Data EngineerLocation : Bangalore, Digital Transformation - R&DJob Description :We are seeking experienced, motivated, and enthusiastic Data Engineering Specialists to join our team. As part of the team, you will be involved in the implementation of ongoing and new initiatives for our company and contribute to our mission of delivering...

  • Staff Engineer

    4 weeks ago

    Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full time

    We are urgently hiring for our client for the position of Staff Engineer - Data Engineering. Location : Anywhere in India.Np : max 30 days.What you'll do : As the Staff Engineer of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment. Staff...

  • Staff Engineer

    2 months ago

    Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full time

    We are urgently hiring for our client for the position of Staff Engineer - Data Engineering. Location : Anywhere in India.Np : max 30 days.What you'll do : As the Staff Engineer of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment. Staff...

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Programming.com Full time

    Job Description :This is a full-time on-site role as an AWS Data Engineer located in Bengaluru. The AWS Data Engineer will be responsible for daily tasks including data engineering, data modeling, Extract Transform Load (ETL), data warehousing, and data analytics. Qualifications :- Data Engineering and Data Modeling skills- Experience with Extract Transform...

  • Kafka Data Engineer

    2 months ago

    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Mandatory skills : - Azure, Kafka, Data Engineering or any Data Platforms background- Experience with Azure/MS Data Platforms: Postgres Single and Flex, Azure SQL, MS SQL server, Kubernetes- Terraform (Preferred not Compulsory), Bicep or other IaC.- Helm (helm deployments as well writing charts).- Azure DevOps pipelines.- Engineer, Data Engineer, or similar...

  • Kafka Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Mandatory skills : - Azure, Kafka, Data Engineering or any Data Platforms background- Experience with Azure/MS Data Platforms: Postgres Single and Flex, Azure SQL, MS SQL server, Kubernetes- Terraform (Preferred not Compulsory), Bicep or other IaC.- Helm (helm deployments as well writing charts).- Azure DevOps pipelines.- Engineer, Data Engineer, or similar...

  • Senior Data Engineer

    2 months ago

    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India Smartgig Technologies Private Limited Full time

    Data Engineer (6+ Years Experience)Location : Bangalore, HybridAvailability : Immediate to 15 DaysAbout the Role :We are seeking a highly skilled Data Engineer with over 6 years of experience to join our dynamic team in Bangalore. The ideal candidate will have extensive experience with Python and PySpark, along with a strong understanding of data engineering...

  • Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    Company Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    Company Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....

  • Data Engineer

    4 days ago

    Bangalore, Karnataka, India Talpro Full time

    Job Description :Experience : 5 -7 years ( experience in either Java or Python or Both)Big Data exp : 2-5 Years - (Hadoop, snowflake, or Kafka)Education Background : Degree in Computer ScienceDomain : Financial Service or Pharma backgroundBudget : Maximum up to 28 LPAJob Description :This is an exciting opportunity for an experienced Data Engineer. You will...

  • Python Data Engineer

    2 months ago

    Bangalore, Karnataka, India Cyitechsearch Full time

    A Python Data Engineer job description typically includes the following responsibilities, qualifications, and skills:Job Description :Responsibilities :- Develop and maintain robust data pipelines to extract, transform, and load (ETL) data from various sources into data lakes, warehouses, or databases.- Design, build, and optimize data models and schemas to...

  • Software Engineer

    4 weeks ago

    Bangalore, Karnataka, India Talent Xo Full time

    Experience Requirement :- 6 to 13 years of experience in Software Engineering, with a focus on Data and Big Data technologies.- Proven track record of designing, implementing, and maintaining data engineering solutions with high scalability and reliability.Core Skills :- Experience in Data/Big Data Engineering Technologies :- Proficiency in one or more...