Data Engineer

2 weeks ago

BangaloreMumbaiPuneChennaiKolkataNoida, India Change leaders Full time

Primary Skill :


- GCP + Python + SQL

OR

- GCP + Java + SQL

NP : Immediate to 35 Days max

Job Location : Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida

- Bachelor's degree in computer science or a related discipline

- 6+ years of applicable engineering experience

- Experience in GCP, Big Query

- Strong proficiency in Python with an emphasis in building data pipelines

- Ability to write complex SQL to perform common types of analysis and aggregations

- Experience with Apache Airflow or Google Composer

- Detail-oriented and document all the work

- Ability to work with others from diverse skill-sets and backgrounds

- GCP solution architect - certified

Responsibilities :

- Design, develop, and deploy scalable and reliable data pipelines on Google Cloud Platform using services such as Cloud Dataflow, Apache Beam, or Apache Spark on Dataproc.

- Work closely with data scientists and analysts to understand data requirements and implement solutions that enable efficient data processing, analysis, and visualization.

- Build and maintain data ingestion processes from various sources (e.g. databases, APIs, streaming data) into GCP data storage solutions like BigQuery, Cloud Storage, and Cloud SQL.

- Optimize and tune data pipelines for performance, scalability, and cost-effectiveness.

- Implement data security and compliance measures to ensure data integrity and privacy.

- Collaborate with cross-functional teams to support data-driven decision-making and business intelligence initiatives.

- Stay updated with the latest trends and best practices in data engineering and GCP services.

Requirements :

- Bachelor's degree in Computer Science, Engineering, or a related field.

- Proven experience as a data engineer with a focus on designing and building data pipelines and analytics solutions.

- Hands-on experience with Google Cloud Platform services, particularly BigQuery, Cloud Dataflow, Cloud Storage, and Cloud Pub/Sub.

- Proficiency in programming languages such as Python, Java, or Scala for data processing and pipeline development.

- Strong understanding of data modeling, database design principles, and SQL.

- Experience with workflow orchestration tools like Apache Airflow or Google Cloud Composer.

- Familiarity with DevOps practices and tools for CI/CD, version control, and infrastructure as code.

- Excellent problem-solving and analytical skills.

- Effective communication and collaboration skills.

(ref:hirist.tech)

  • Senior Data Engineer

    2 days ago

    Pune, India Data Axle Full time

    Job DescriptionAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Senior Data Engineer

    1 week ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    4 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Wavicle Data Solutions

    2 weeks ago

    Chennai/Coimbatore, India Wavicle data solutions Full time

    Job Description :- We are seeking a highly experienced Senior and Lead Data Engineer with over 6 years of expertise in data engineering.- As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.- Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for...

  • Senior Data Scientist

    1 week ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based...

  • Senior Data Scientist

    4 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Specialist Data center operations

    4 weeks ago

    Kolkata, India NTT DATA Full time

    The role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...

  • Specialist Data center operations

    4 weeks ago

    Kolkata, India NTT DATA Full time

    The role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...

  • Aptus Data Labs

    3 weeks ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp- 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Aptus Data Labs

    2 weeks ago

    Bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Aptus Data Labs

    4 weeks ago

    bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Data Engineer

    3 weeks ago

    Bangalore/Mumbai/Pune/Chennai/Kolkata/Noida, IN Change leaders Full time

    Primary Skill : - GCP + Python + SQLOR- GCP + Java + SQLNP : Immediate to 35 Days maxJob Location : Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida- Bachelor's degree in computer science or a related discipline- 6+ years of applicable engineering experience- Experience in GCP, Big Query- Strong proficiency in Python with an emphasis in...

  • Software Engineer

    2 weeks ago

    Pune, India Data Axle Full time

    Job DescriptionAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Software Engineer

    3 weeks ago

    Pune, India Data Axle Full time

    Job DescriptionAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Data Engineer

    3 weeks ago

    Bangalore/Noida, IN Xperthunt Full time

    About the Role :We're seeking a highly skilled Data Engineer to join our team and play a pivotal role in building and maintaining our data infrastructure.You'll collaborate closely with data scientists, analysts, and stakeholders to understand their data needs and design, develop, and implement data solutions that empower effective analysis and...

  • Data Engineer

    2 weeks ago

    Bangalore/Noida, India Xperthunt Full time

    About the Role : We're seeking a highly skilled Data Engineer to join our team and play a pivotal role in building and maintaining our data infrastructure. You'll collaborate closely with data scientists, analysts, and stakeholders to understand their data needs and design, develop, and implement data solutions that empower effective analysis and...

  • Software Engineer

    2 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Software Engineer

    2 weeks ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based...

  • Software Engineer

    4 weeks ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Software Engineer

    4 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...