Big Data Engineer
2 days ago
Role - Senior Data Engineer
Location: Pune, Hyderabad(Hybrid)
Experience - 6+ Years
Responsibilities
· Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.
· Collaborate with product and technology teams to design and validate the capabilities of the data platform
· Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability
· Provide technical support and usage guidance to the users of our platform's services.
· Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.
Qualifications
· Experience building and optimizing data pipelines in a distributed environment
· Experience supporting and working with cross-functional teams
· Proficiency working in Linux environment
· 4+ years of advanced working knowledge of SQL, Python, and PySpark
· Knowledge on Palantir
· Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline
· Experience with platform monitoring and alerts tools
Thanks and Regards
Sunny Tiwari
Please share your resume
-
Big Data Engineer
4 hours ago
Pune, Maharashtra, India Talent Sketchers Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDesignation: Big Data EngineerExperience: 4+ YearsWork Mode: Remote OpportunityNotice Period: Immediate Joiners/ Serving Notice PeriodJob Description:Role: Big Data EngineerThis Data Engineer will be engaged in data science-related research and software application development and engineering duties related to our enterprise-grade Wi-Fi technology to provide...
-
Big Data Engineer
5 days ago
Pune, Maharashtra, India RiskInsight Consulting Pvt Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per yearResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databasesBuild and maintain scalable data pipelines for effective data ingestion, transformation, and analysisCollaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them...
-
Big Data Engineer
1 week ago
Pune, Maharashtra, India Information Technology Full time ₹ 8,00,000 - ₹ 24,00,000 per yearBig Data EngineerKey Responsibilities : - Build and manage highly scalable Big Data pipelines for large structured datasets. - Collaborate with Product Management & Engineering leadership to design and implement optimal solutions. - Participate in design discussions and contribute to selecting, integrating, and maintaining Big Data frameworks. -...
-
Big Data Engineer
1 week ago
Pune, Maharashtra, India Coforge Full time ₹ 15,00,000 - ₹ 25,00,000 per yearCoforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills:- AWS, Spark & Scala.Experience Required: 3 to 6 YearsJob Locations: Pune, Hyderabad, Greater Noida Only.Send your CV to: For queries, contact via WhatsApp: Key Responsibilities:-• Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale,...
-
Big Data Engineer
44 minutes ago
Pune, Maharashtra, India Capco Technologies Pvt Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per yearBig Data Engineer Job Title: Big Data Engineer About Us "Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100...
-
Big Data Engineer
7 days ago
Pune, Maharashtra, India Information Technology Full time ₹ 15,00,000 - ₹ 25,00,000 per yearKey ResponsibilitiesBuild and manage highly scalable Big Data pipelines for large structured datasets.Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.Participate in design discussions and contribute to selecting, integrating, and maintaining Big Data frameworks.Develop distributed data processing systems...
-
Big Data Engineer
1 week ago
Pune, Maharashtra, India Capco Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Title: Big Data EngineerAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking,...
-
Big Data Engineer
7 days ago
Pune, Maharashtra, India Capco Full time ₹ 1,20,000 - ₹ 1,80,000 per yearJob Title:Big Data EngineerAbout Us"Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 byAvtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking,...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India Talent Worx Full time ₹ 15,00,000 - ₹ 25,00,000 per yearLocation – Pune/ChennaiExp - 6 to 9RequirementsTechnology: - Big Data (Hadoop, Hive, Spark, Scala, PLSQL/ No SQL Database)Knowledge/Experience (Must):· 6-9 years of experience in Hadoop/big data technologies.· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and eventbased messaging.· Relational and NoSQL database integration...
-
Big Data Engineer
2 days ago
Pune, Maharashtra, India Talent Worx Full time ₹ 10,00,000 - ₹ 25,00,000 per yearLocation – Pune/ChennaiExp - 6 to 9Technology: - Big Data (Hadoop, Hive, Spark, Scala, PLSQL/ No SQL Database)Knowledge/Experience (Must):· 6-9 years of experience in Hadoop/big data technologies.· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and eventbased messaging.· Relational and NoSQL database integration and data...