Big Data Engineer
3 days ago
We are seeking a highly skilled Big Data Engineer - Databricks Expert to join our team at LTIMindtree. The ideal candidate will have experience with Azure Databricks, Python, and Time Series Processing.
About the Role
As a Big Data Engineer - Databricks Expert, you will design, construct, install, test, and maintain highly scalable data management systems using Azure Databricks. You will develop data processing pipelines using Databricks Notebooks, Spark SQL, and other Databricks utilities. Additionally, you will integrate Azure Databricks with other Azure services such as Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DB. Your primary responsibility will be to ensure optimal performance of data processing and extraction, transformation, and loading (ETL) processes.
Responsibilities
* Design and implement high availability and low latency applications
* Ensure data reliability, efficiency, and quality
* Monitor data infrastructure needs and assist stakeholders with data-related technical issues
* Develop and maintain documentation related to data pipeline architecture, development processes, and data governance
* Collaborate with data architects to implement effective data models and schemas within the Databricks environment
Requirements
* 12-16 years of experience in big data engineering with expertise in Azure Databricks
* Strong knowledge of Python, Pandas, NumPy, and other relevant libraries
* Experience with Time Series Analysis and predictive modeling
* Ability to work with stakeholders to identify and prioritize data infrastructure needs
* Excellent communication and problem-solving skills
What We Offer
* Competitive salary: ₹20,00,000 - ₹25,00,000 per annum
* Opportunities for career growth and professional development
* Collaborative and dynamic work environment
* Recognition and rewards for outstanding performance
-
Senior Big Data Developer
3 weeks ago
Pune, Maharashtra, India NTT DATA Full timeCompany OverviewNTT DATA is a global technology services company that helps clients innovate, optimize and transform for long term success. We have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our Commitment to YouEstimated Salary: ₹2,200,000 - ₹3,500,000 per annum (dependent on...
-
Data Engineer
3 days ago
Pune, Maharashtra, India LTIMindtree Full timeJob DescriptionWe are seeking a highly skilled Data Engineer to join our team at LTIMindtree. As a Data Engineer, you will play a key role in designing and developing big data platforms using Scala and Spark.Responsibilities:Design and develop big data platforms using Scala and Spark.Develop expertise in Data Engineering, including hands-on experience in...
-
Scalable Big Data Engineer
2 weeks ago
Pune, Maharashtra, India Virtusa Full timeJob Title: Scalable Big Data EngineerAbout the RoleVirtusa is seeking an experienced Scala and Spark Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Scala and Spark.Key Responsibilities- Design and develop scalable big data...
-
Data Engineer Leader
1 month ago
Pune, Maharashtra, India DATAECONOMY Full timeAbout the RoleDataEconomy is seeking a Senior Data Engineer to lead our team in designing and implementing big data solutions using PySpark.Key ResponsibilitiesLead the design and implementation of scalable and robust data pipelines using PySpark.Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.Mentor and...
-
Big Data Engineering Specialist
3 days ago
Pune, Maharashtra, India LTIMindtree Full timeWe are seeking a highly skilled Big Data Engineering Specialist to join our team at LTIMindtree. As a key member of our big data engineering team, you will be responsible for designing and developing scalable big data platforms using modern technologies like Scala Spark and Hadoop ecosystem.This role requires a deep understanding of modern data processing...
-
GCP Data Engineer
5 days ago
Pune, Maharashtra, India Tata Consultancy Services Full timeWe are looking for a highly skilled GCP Data Engineer - Big Data Expert to join our team at Tata Consultancy Services. As a GCP Data Engineer, you will play a critical role in designing and implementing scalable data processing systems on Google Cloud Platform.About the Role:We are seeking an experienced professional with a strong background in GCP-based big...
-
Senior Data Engineer
3 weeks ago
Pune, Maharashtra, India TapTalent Full timeTapTalent is a leading player in the job market, and we're looking for a seasoned Data Engineer to join our team. As a senior member of our engineering team, you will play a crucial role in designing and developing our big data platform.We're looking for someone with at least 4 years of experience in working with Scala Spark. If you have expertise in data...
-
Big Data Engineer Specialist
2 weeks ago
Pune, Maharashtra, India Consulting Pandits Full timeAbout Consulting PanditsWe are a leading consulting firm specializing in data-driven solutions.Job OverviewWe are seeking an experienced Big Data Engineer to join our team. This role will involve designing, developing, and deploying end-to-end data storage and processing pipelines using big data technologies.Estimated Salary Range$120,000 - $180,000 per year...
-
Highly Scalable Big Data Engineer
3 days ago
Pune, Maharashtra, India Recro Full timeAbout the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Recro.Job DescriptionIn this role, you will be responsible for designing and implementing scalable data pipelines using distributed processing tools like Akka and Spark.You will work closely with Product Management and Engineering leadership to devise and build the right...
-
Big Data Engineering Leader Position
6 days ago
Pune, Maharashtra, India Circana Full timeAt Circana, we are on a mission to empower our team members with the skills and knowledge they need to excel in their roles. As a Big Data Engineer Lead, you will be part of a dynamic team that is passionate about delivering high-quality solutions.We are seeking an experienced technical lead who can evaluate domain, financial, and technical feasibility of...
-
Big Data Solutions Architect
2 days ago
Pune, Maharashtra, India Mig Staffing Full timeAbout Mig StaffingWe are a leading staffing agency specializing in the placement of highly skilled professionals in various industries. Our team of experts works closely with clients to understand their unique needs and requirements.Job Title: Big Data Solutions ArchitectJob Summary:We are seeking an experienced Big Data Solutions Architect to join our team....
-
Big Data Automation Engineer
6 days ago
Pune, Maharashtra, India PubMatic Full timeAbout the Role:The ideal candidate will have 1-3 years of experience working as a Software Development Engineer in Test (SDET) and have done meaningful automation.A strong understanding of programming skills, with Python being preferred, is essential for this role.Hands-on experience in automating backend applications, such as databases and REST APIs, is...
-
Big Data Solutions Developer
2 weeks ago
Pune, Maharashtra, India Mig Staffing Full timeJob Title: Big Data Solutions DeveloperJob Description:Mig Staffing is seeking a Big Data Solutions Developer to design, implement, and manage our company's big data solutions. Key responsibilities include developing Hadoop systems, loading disparate data sets, conducting pre-processing services, and collaborating with software research and development...
-
Big Data Engineer for Platform Optimization
7 days ago
Pune, Maharashtra, India Talentmatics Full timeJob DescriptionTalentmatics is seeking an experienced Big Data Engineer to optimize our big data platform in Pune and Hyderabad locations.We offer a competitive salary of ₹1,200,000 per annum, commensurate with experience, to manage and maintain our big data ecosystem.About the RoleThis is an exciting opportunity to work on secured environments using...
-
Big Data Engineer
1 month ago
Pune, Maharashtra, India Avaloq Full timeAbout the Role:We're looking for a skilled Big Data Engineer to join our team at Avaloq and help shape the next generation of our data solutions for Wealth Management and Banking.Your Key Responsibilities:Create scalable and reliable data pipelines that ingest, process, and deliver data from various sources to our real-time data platform.Closely collaborate...
-
Data Engineering Lead
3 days ago
Pune, Maharashtra, India Wipro Full timeJob Title: Data Engineering Lead - Big Data Platform ArchitectAre you an experienced data engineering professional looking to take your career to the next level? We are seeking a skilled Data Engineering Lead - Big Data Platform Architect to join our team at Wipro.Estimated Salary: ₹20,00,000 - ₹30,00,000 per annumWe offer a highly competitive salary...
-
Pune, Maharashtra, India PubMatic Full timeAbout the RoleWe are seeking an experienced Senior Software Development Engineer to join our team in designing, developing, and testing complex engineering projects. The ideal candidate will have a strong background in software development, testing methodologies, and big data technologies.Key ResponsibilitiesDevelop automation frameworks using Python to...
-
Pune, Maharashtra, India Radical Technologies Full time**Job Title:** Cloud Computing Engineer with Big Data Experience**Company Overview:** Radical Technologies is a cutting-edge company that empowers innovation through data-driven solutions.**Salary:** ₹25,00,000 - ₹40,00,000 per annum based on experience and qualifications.**Job Description:We are seeking an experienced Cloud Computing Engineer to join...
-
Senior Data Pipeline Engineer
3 days ago
Pune, Maharashtra, India Tata Consultancy Services Full timeAbout the RoleWe are seeking a highly skilled Senior Data Pipeline Engineer to join our team in Pune, Hyderabad, Bangalore, Chennai, Noida or Nagpur. The ideal candidate will have 5-10 years of experience in designing and building production data pipelines using Cloud Native GCP, Python, SQL and other relevant technologies.Key ResponsibilitiesDesign and...
-
Principal Data Architect
3 weeks ago
Pune, Maharashtra, India Data Axle Full timeAbout Data Axle:Data Axle Inc. is a 50-year-old industry leader in data, marketing solutions, sales, and research in the US.We have set up a strategic global centre of excellence in Pune, delivering mission-critical data services to our global customers powered by our proprietary cloud-based technology platform and leveraging our proprietary business &...