Cloud Big Data Engineer
1 week ago
We are hiring Cloud Big Data Engineer.
Location : Experience level : 5+ years.
Required Skills : GCP, BigData, Pyspark, Python, Spark, Kafka, Hadoop, Hive, Scala/Django, DFS Elastic search.
Key Responsibilities :
- Design, develop, and implement big data solutions on the Google Cloud Platform (GCP).
- Develop and maintain data pipelines for data ingestion, transformation, and loading into data warehouses and data lakes.
- Work with Apache Spark, Hadoop (HDFS, Hive), and other big data technologies to process and analyze large datasets.
- Develop and deploy data pipelines using tools like Apache Kafka.
- Utilize NoSQL databases such as ElasticSearch for data storage and retrieval.
- Develop and maintain data quality checks and ensure data integrity.
- Collaborate with data analysts, data scientists, and other stakeholders to understand business requirements and translate them into technical solutions.
- Optimize data pipelines for performance and scalability.
- Troubleshoot and resolve data-related issues.
- Stay up-to-date with the latest advancements in big data technologies and cloud :
Education : Bachelor's degree in Computer Science, Engineering, or a related field.
Experience : 5+ years of experience in big data engineering, data warehousing, or a related field.
Technical Skills :
- Strong proficiency in Python and experience with frameworks like Django.
- In-depth knowledge of Apache Spark, Hadoop (HDFS, Hive), and other big data technologies.
- Experience with data ingestion, transformation, and loading tools.
- Experience with NoSQL databases, particularly ElasticSearch.
- Experience with cloud platforms, preferably GCP.
- Proficiency in Linux/Unix and shell scripting.
Preferred Skills :
- Experience with data streaming platforms like Kafka.
- Experience with data visualization and reporting tools (e.g., Tableau, Power BI).
- Experience with containerization technologies (Docker, Kubernetes).
- Knowledge of distributed systems concepts (load balancing, sharding, data distribution).
- Cloud certifications (e.g., Google Cloud Certified Professional Data Engineer)
(ref:hirist.tech)-
Cloud Data Engineer
17 hours ago
Pune, Maharashtra, India Persistent Systems Full timeAbout the Role:We are seeking a highly skilled Cloud Data Engineer with expertise in big data technologies to join our team at Persistent Systems.As a Cloud Data Engineer, you will design, build, and maintain scalable and efficient data pipelines using cloud-based platforms such as GCP. You will work closely with analysts, engineers, and planners to create...
-
Big Data Engineer
3 weeks ago
Pune, Maharashtra, India Where U Elevate Full timeSenior Big Data Engineer JobWe are seeking a seasoned Senior Big Data Engineer to join our team at Where U Elevate. This role requires someone who can design and implement robust data architecture, work with cross-functional teams, and ensure high-quality data products.Your Responsibilities:Design and implement scalable data architectureCollaborate with...
-
Senior Big Data Engineer
3 weeks ago
Pune, Maharashtra, India Synechron Full timeJob Title: Senior Big Data EngineerEstimated Salary: ₹1,500,000 - ₹2,000,000 per annumAt Synechron, we are looking for a highly skilled Senior Big Data Engineer to join our team. The ideal candidate will have a solid understanding of big data technologies and be able to design and implement scalable data solutions using AWS services.About the Role:We are...
-
Big Data Engineering Lead
3 weeks ago
Pune, Maharashtra, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full timeSenior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to work on cutting-edge projects at Aexonic Technologies Pvt. Ltd.This individual will design and optimize Big Data pipelines with Hadoop, Hive, PySpark, and Google BigQuery, and architect scalable data solutions on Google Cloud Platform (GCP).Responsibilities:Design and...
-
Senior Big Data Engineer
1 month ago
Pune, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full timeAre you ready to take your Big Data expertise to the next level? Join our dynamic team at Aexonic Technologies Pvt. Ltd. as a Senior Big Data Engineer (GCP) and work on cutting-edge projects in a collaborative and innovative environment.Role : Senior Big Data Engineer (GCP) Experience : 5+ years in Big Data technologies Shift : EST Shift (5:30 PM - 2:30 AM...
-
Senior Big Data Engineer
2 weeks ago
Pune, Maharashtra, India Nagarro Software Pvt. Ltd Full timeJob Title: Senior Big Data EngineerWe are seeking an experienced Senior Big Data Engineer to join our team at Nagarro Software Pvt. Ltd. This role involves working with large datasets and designing scalable data architectures.About the Role:Design and develop big data solutions using technologies like Apache Spark, Python, and PL/SQL/NoSQL/SQL.Work with...
-
GCP Data Engineer
4 weeks ago
Pune, Maharashtra, India Tata Consultancy Services Full timeWe are looking for a highly skilled GCP Data Engineer - Big Data Expert to join our team at Tata Consultancy Services. As a GCP Data Engineer, you will play a critical role in designing and implementing scalable data processing systems on Google Cloud Platform.About the Role:We are seeking an experienced professional with a strong background in GCP-based big...
-
Big Data Engineer
3 weeks ago
Pune, Maharashtra, India Amk technologies Full timeAbout Amk Technologies: We are a leading technology company that provides innovative solutions to our clients.Job Title: Big Data EngineerThe successful candidate will work on building and maintaining scalable, high-performance data pipelines to process large datasets. The ideal candidate will have strong experience with cloud-based data solutions, data...
-
Big Data Engineer
2 months ago
Pune, India Mig Staffing Full timeWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.To ensure success as a big data...
-
Big Data Engineer
1 day ago
Pune, Maharashtra, India ACL Digital Full timeAre you passionate about building scalable and efficient data platforms?A challenging role awaits at ACL Digital, where you will design, implement, and operate streaming and batch pipelines that scale.You will develop services connecting dots by writing scripts in Python using various libraries and frameworks. Partner with both engineers and data analysts to...
-
Big Data Engineer
1 month ago
Pune, India Mig Staffing Full timeJob Description : We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production : - Meeting with...
-
Intern Iii-big Data and Lyve Cloud
1 week ago
Pune, India Seagate Technology Full time**About our group**: The group is part of the Seagate's Big data analytics & LYVE cloud solutions & services. LYVE Cloud Storage-as-a-Service platform is an S3-compatible storage-only cloud that enables always-on mass capacity data storage and activation. It is designed as a simple, trusted, and efficient service allowing enterprises to unlock the value of...
-
Data Engineer for Big Data Solutions
1 day ago
Pune, Maharashtra, India Birlasoft Full timeAbout Birlasoft: A Partner in Digital TransformationBirlasoft is a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and...
-
Big Data Architect
4 days ago
Pune, India Coditas Full time**Roles and responsibilities**- Overall 12 years of experience with 6+ yrs. Of hands on experience with Data Technologies- Requirement analysis and assess technical feasibility of proposed solutions.- Implement data ingestion and transform pipeline for analytics and Dashboard reporting for business- Involved in creating tables, loading with data and writing...
-
Big Data Engineer
3 weeks ago
Pune, Maharashtra, India Digikore Studios Full timeDigital Content Creation Company Seeks Data Engineer">Digikore Studios, a leading digital content creation company, is seeking a highly skilled Data Engineer to join its team in Viman Nagar, Pune.">About the Role">This is an exciting opportunity for a seasoned professional to design, build, and maintain the infrastructure necessary for efficient data...
-
Senior Engineer
1 month ago
Pune, India Infinity career edge Full timeResponsibilities :- Works closely with the business owner / Product owner / Cross functional Team and gathering technical requirements.- Experience in building and maintaining reliable and scalable ETL pipeline on big data & / or Cloud platform through the collection, storage, processing, and transformation of large datasets.- Collaborate with other teams to...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India LTIMindtree Full timeLTIMindtree is a leading global technology consulting and services company. We are seeking an experienced Big Data Developer to join our team.We offer a competitive salary of $120,000 per annum, commensurate with experience.About the RoleThis role involves designing and developing big data platforms using Scala and Spark technologies. The ideal candidate...
-
Senior Big Data Engineer
2 months ago
Pune, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full timePosition - Senior Big Data Engineer (GCP)Experience - 5 to 8 YrsLocation - RemoteShift - EST Shift 5:30 PM to 2:30 AMWe are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery. The successful candidate will be...
-
Mumbai/Pune/Kolkata/Delhi/Nagpur/Ahmedabad, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full timeSenior Big Data Engineer (GCP)AEXONIC TECHNOLOGIES PRIVATE LIMITED is seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery.The successful candidate will be responsible for designing, building, and maintaining robust data...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India LTIMindtree Full timeJob Summary:We are looking for a highly skilled Big Data Engineer to join our team at LTIMindtree. The successful candidate will have extensive experience in designing and implementing large-scale data processing systems using Spark.Key Responsibilities:Design and implement data processing pipelines using SparkOptimize system performance and...