Cloud Big Data Engineer
1 week ago
About the Role :
We are seeking a highly skilled and experienced Cloud Big Data Engineer to join our growing team. In this role, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines and applications on the cloud.
You will work with large datasets, leveraging big data technologies to extract meaningful insights and drive business decisions.
Key Responsibilities :
- Hands-on experience with core big data technologies: Hadoop, Hive, HDFS, Spark (PySpark), and related ecosystem components.
- Develop and optimize data pipelines using Spark for data ingestion, transformation, and analysis.
- Strong understanding of cloud platforms, with a focus on Google Cloud Platform (GCP) is preferred.
- Experience with cloud-based data services (i.e., Google Cloud Storage, BigQuery, Dataflow).
- Experience with data ingestion, transformation, and loading (ETL/ELT) processes.
- Proficiency in data modeling and data warehousing concepts.
- Strong proficiency in Python and related frameworks (i.e., Django).
- Experience with shell scripting (Bash, etc.)
- Working knowledge of file formats such as JSON, Parquet, AVRO, and ORC.
- Experience with job scheduling and debugging in a production environment.
- Understanding of distributed systems concepts like load balancing, sharding, and data distribution.
Qualifications :
Experience : 5+ years of experience in Big Data engineering.
Technical Skills :
- Strong proficiency in Python, Spark (PySpark), Hadoop (HDFS, Hive).
- Experience with GCP or other cloud platforms.
- Working knowledge of data warehousing concepts.
- Experience with data ingestion and ETL processes.
Education : Bachelor's degree in Computer Science, Engineering, or a related field.
Other Skills :
- Excellent problem-solving and analytical skills.
- Strong communication and interpersonal skills.
- Ability to work independently and as part of a team
-
Big Data Engineer
6 days ago
Anywhere in India/Multiple Locations AEXONIC TECHNOLOGIES PRIVATE LIMITED Full timePosition : Sr Big Data Engineer (GCP)Experience : 5 to 8 YrsLocation : Remote Shift Time : EST Shift (5:30 PM to 2:30 AM)Position Overview : We are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery. The successful...
-
Cloud Big Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations/Bangalore Lakshya Software Technologies Private Limited Full timeAbout the Role : We are seeking a highly skilled and experienced Cloud Big Data Engineer to join our growing team. In this role, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines and applications on the cloud. You will work with large datasets, leveraging big data technologies to extract meaningful...
-
Big Data Engineer
6 days ago
Anywhere in India/Multiple Locations Spruce IT Pvt. Ltd. Full timeResponsibilities :- Design, develop, and implement robust big data pipelines and ETL processes using Hadoop and PySpark.- Perform data analysis, transformation, and cleansing to extract valuable insights.- Optimize performance and scalability of big data applications.- Collaborate with data scientists and analysts to understand data requirements and...
-
Big Data Solutions Architect
5 days ago
Anywhere in India/Multiple Locations AEXONIC TECHNOLOGIES PRIVATE LIMITED Full timeAbout UsAEXONIC TECHNOLOGIES PRIVATE LIMITED is a leading provider of innovative solutions in the field of Big Data and Analytics. We are committed to delivering high-quality services and solutions to our clients.We are seeking a highly skilled Senior Big Data Engineer to join our team. The ideal candidate will have extensive experience in Big Data...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations CA-One Tech Cloud Full timeJob Description : Data Engineer (4+ Years Experience) Position : Data Engineer Location : Remote Employment Type : Full-time Experience : 4+ years Start Date : Immediate Job Overview : We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will possess expertise in advanced technologies such as Python, RAG...
-
Big Data Solutions Specialist
5 days ago
Anywhere in India/Multiple Locations Spruce IT Pvt. Ltd. Full timeSpruce IT Pvt. Ltd. is expanding its team and looking for a skilled Big Data Solutions Specialist to drive the development of innovative data-driven products and services. As part of our mission to harness the power of big data, you will be responsible for designing, implementing, and maintaining robust data pipelines and ETL processes using Hadoop and...
-
Lead Big Data Engineer
2 days ago
Anywhere in India/Multiple Locations AJ Consulting Full timeAbout the RoleThe Lead Big Data Engineer - AI Consulting will be responsible for leading a team of data engineers in the design and implementation of big data solutions using PySpark. This role requires expertise in PySpark, Hadoop, Hive, and Spark, as well as strong leadership and collaboration skills.You will work closely with cross-functional teams to...
-
Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations CA-One Tech Cloud Full timeJob Description : Data Engineer (4+ Years Experience) Position : Data Engineer Location : Remote Employment Type : Full-time Experience : 4+ years Start Date : Immediate Job Overview : We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will possess expertise in advanced technologies such as Python, RAG...
-
Cloud ML Engineering Lead
1 hour ago
Anywhere in India/Multiple Locations Volto Consulting & Services Full time**Job Summary**We are looking for an experienced Senior Machine Learning Engineer to join our team at Volto Consulting & Services. As a Senior Machine Learning Engineer, you will be responsible for providing technical expertise and support to the Gaming AI Squad and contributing to the development of end-to-end machine learning applications.**Key...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations Patch Infotech Private Limited Full timeKey Responsibilities : - Design, develop, and implement data pipelines to extract, transform, and load (ETL) data from various sources (databases, APIs, cloud storage, streaming platforms). - Develop and maintain data pipelines using tools like Apache Spark, Kafka, and other big data technologies.- Ensure data quality and integrity throughout the data...
-
Senior Data Engineer
6 days ago
Anywhere in India/Multiple Locations AEXONIC TECHNOLOGIES PRIVATE LIMITED Full timeJob DescriptionWe are seeking a highly skilled Senior Big Data Engineer to join our team at AEXONIC TECHNOLOGIES PRIVATE LIMITED. The ideal candidate will have extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery.This role requires excellent data analysis skills and the...
-
Cloud Data Architect
5 days ago
Anywhere in India/Multiple Locations CA-One Tech Cloud Full timeKey Responsibilities- Design, develop, and implement robust data pipelines and ETL processes to extract, transform, and load data from various sources into a cloud-based data warehouse on Azure.- Utilize RAG and graph database structures to optimize data retrieval and query performance for efficient data analysis and reporting.- Build scalable APIs for data...
-
NucleusTeq - Big Data Engineer - Spark/Scala
2 weeks ago
Anywhere in India/Multiple Locations/Remote NucleusTeq Consulting Pvt. Ltd. Full timeRole : Big Data Engineer Responsibilities :- Big Data Engineer with 5-6 years of experience- Experience in leading a team of engineers and a good attitude toward learning the domain and implementation- Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.- Finalizing the scope of the system and...
-
Cloud Native Engineer
2 days ago
Anywhere in India/Multiple Locations Liftu Technology Private Limited Full timeResponsibilities- Develop and maintain our backend workflow engine using Go- Design and implement scalable, high-performance distributed systems- Work with big data technologies and stream processing platforms- Optimize backend systems for scalability and reliability- Collaborate with the team on AWS cloud services and DevOps practices
-
Anywhere in India/Multiple Locations AEONOVATECH PRIVATE LIMITED Full timeKey Responsibilities :- Lead and mentor a team of Big Data Engineers.- Participate in the design and implementation of the big data analytics architecture on Azure.- Develop and implement big data pipelines using Spark Scala and Python.- Write complex Hive queries to extract valuable insights from data lakes.- Collaborate with cross-functional teams (QA,...
-
Cloud Data Engineer
5 days ago
Anywhere in India/Multiple Locations AEXONIC TECHNOLOGIES PRIVATE LIMITED Full timeKey RequirementsTo be considered for this position, you must have:Minimum of 8 years of industry experience working with Big Data technologies.Proficiency in Hadoop, Hive, and PySpark for data processing.Strong experience with Unix Shell Scripting.Expertise in SQL and extracting data from multiple sources.Demonstrated experience in data analysis,...
-
Data Engineering Expert
6 days ago
Anywhere in India/Multiple Locations CA-One Tech Cloud Full timeJob OverviewWe are seeking a skilled and motivated Data Engineer to join our team at CA-One Tech Cloud. The ideal candidate will possess expertise in advanced technologies such as Python, RAG (Retrieval-Augmented Generation), graph databases, API development, Docker, Azure, machine learning (ML), and artificial intelligence (AI). This position requires...
-
Senior Data Engineer
3 weeks ago
india Orange Business Full timeOverviewWe are looking for a creative, talented, and motivated Sr. Cloud Data Engineer to work in our growing India Development Center. In this role, you will be instrumental in architecting, building, and managing our data infra on Google Cloud Platform GCP and Big Data Setup on prem. The ideal candidate will be well versed in data engineering and cloud...
-
Big Data Solutions Specialist
6 days ago
Anywhere in India/Multiple Locations Genpact Full timeTransforming Businesses with Data ExpertiseAs a Principal Consultant, AWS Data Engineer, you will leverage your technical expertise to drive business transformation. Our dynamic Engineering team collaborates to deliver innovative data-driven solutions that drive results. With your experience in data engineering and strong problem-solving skills, you'll excel...
-
Big Data Solutions Expert
5 days ago
Anywhere in India/Multiple Locations Sureminds Full time**Required Skills and Qualifications**To be successful in this role, you will need to possess the following skills and qualifications:Bachelor's degree in Engineering, Computer Science, Data Science, or related field3+ years of experience in software development, data science, data engineering, ETL, and analytics reporting developmentExperience designing,...