Big Data Engineer

3 days ago


Pune, Maharashtra, India LTIMindtree Full time
Job Summary
We are seeking a highly skilled Big Data Engineer - Databricks Expert to join our team at LTIMindtree. The ideal candidate will have experience with Azure Databricks, Python, and Time Series Processing.

About the Role
As a Big Data Engineer - Databricks Expert, you will design, construct, install, test, and maintain highly scalable data management systems using Azure Databricks. You will develop data processing pipelines using Databricks Notebooks, Spark SQL, and other Databricks utilities. Additionally, you will integrate Azure Databricks with other Azure services such as Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DB. Your primary responsibility will be to ensure optimal performance of data processing and extraction, transformation, and loading (ETL) processes.

Responsibilities
* Design and implement high availability and low latency applications
* Ensure data reliability, efficiency, and quality
* Monitor data infrastructure needs and assist stakeholders with data-related technical issues
* Develop and maintain documentation related to data pipeline architecture, development processes, and data governance
* Collaborate with data architects to implement effective data models and schemas within the Databricks environment

Requirements
* 12-16 years of experience in big data engineering with expertise in Azure Databricks
* Strong knowledge of Python, Pandas, NumPy, and other relevant libraries
* Experience with Time Series Analysis and predictive modeling
* Ability to work with stakeholders to identify and prioritize data infrastructure needs
* Excellent communication and problem-solving skills

What We Offer
* Competitive salary: ₹20,00,000 - ₹25,00,000 per annum
* Opportunities for career growth and professional development
* Collaborative and dynamic work environment
* Recognition and rewards for outstanding performance

  • Pune, Maharashtra, India NTT DATA Full time

    Company OverviewNTT DATA is a global technology services company that helps clients innovate, optimize and transform for long term success. We have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our Commitment to YouEstimated Salary: ₹2,200,000 - ₹3,500,000 per annum (dependent on...

  • Data Engineer

    3 days ago


    Pune, Maharashtra, India LTIMindtree Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at LTIMindtree. As a Data Engineer, you will play a key role in designing and developing big data platforms using Scala and Spark.Responsibilities:Design and develop big data platforms using Scala and Spark.Develop expertise in Data Engineering, including hands-on experience in...


  • Pune, Maharashtra, India Virtusa Full time

    Job Title: Scalable Big Data EngineerAbout the RoleVirtusa is seeking an experienced Scala and Spark Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Scala and Spark.Key Responsibilities- Design and develop scalable big data...

  • Data Engineer Leader

    1 month ago


    Pune, Maharashtra, India DATAECONOMY Full time

    About the RoleDataEconomy is seeking a Senior Data Engineer to lead our team in designing and implementing big data solutions using PySpark.Key ResponsibilitiesLead the design and implementation of scalable and robust data pipelines using PySpark.Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.Mentor and...


  • Pune, Maharashtra, India LTIMindtree Full time

    We are seeking a highly skilled Big Data Engineering Specialist to join our team at LTIMindtree. As a key member of our big data engineering team, you will be responsible for designing and developing scalable big data platforms using modern technologies like Scala Spark and Hadoop ecosystem.This role requires a deep understanding of modern data processing...

  • GCP Data Engineer

    5 days ago


    Pune, Maharashtra, India Tata Consultancy Services Full time

    We are looking for a highly skilled GCP Data Engineer - Big Data Expert to join our team at Tata Consultancy Services. As a GCP Data Engineer, you will play a critical role in designing and implementing scalable data processing systems on Google Cloud Platform.About the Role:We are seeking an experienced professional with a strong background in GCP-based big...

  • Senior Data Engineer

    3 weeks ago


    Pune, Maharashtra, India TapTalent Full time

    TapTalent is a leading player in the job market, and we're looking for a seasoned Data Engineer to join our team. As a senior member of our engineering team, you will play a crucial role in designing and developing our big data platform.We're looking for someone with at least 4 years of experience in working with Scala Spark. If you have expertise in data...


  • Pune, Maharashtra, India Consulting Pandits Full time

    About Consulting PanditsWe are a leading consulting firm specializing in data-driven solutions.Job OverviewWe are seeking an experienced Big Data Engineer to join our team. This role will involve designing, developing, and deploying end-to-end data storage and processing pipelines using big data technologies.Estimated Salary Range$120,000 - $180,000 per year...


  • Pune, Maharashtra, India Recro Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Recro.Job DescriptionIn this role, you will be responsible for designing and implementing scalable data pipelines using distributed processing tools like Akka and Spark.You will work closely with Product Management and Engineering leadership to devise and build the right...


  • Pune, Maharashtra, India Circana Full time

    At Circana, we are on a mission to empower our team members with the skills and knowledge they need to excel in their roles. As a Big Data Engineer Lead, you will be part of a dynamic team that is passionate about delivering high-quality solutions.We are seeking an experienced technical lead who can evaluate domain, financial, and technical feasibility of...


  • Pune, Maharashtra, India Mig Staffing Full time

    About Mig StaffingWe are a leading staffing agency specializing in the placement of highly skilled professionals in various industries. Our team of experts works closely with clients to understand their unique needs and requirements.Job Title: Big Data Solutions ArchitectJob Summary:We are seeking an experienced Big Data Solutions Architect to join our team....


  • Pune, Maharashtra, India PubMatic Full time

    About the Role:The ideal candidate will have 1-3 years of experience working as a Software Development Engineer in Test (SDET) and have done meaningful automation.A strong understanding of programming skills, with Python being preferred, is essential for this role.Hands-on experience in automating backend applications, such as databases and REST APIs, is...


  • Pune, Maharashtra, India Mig Staffing Full time

    Job Title: Big Data Solutions DeveloperJob Description:Mig Staffing is seeking a Big Data Solutions Developer to design, implement, and manage our company's big data solutions. Key responsibilities include developing Hadoop systems, loading disparate data sets, conducting pre-processing services, and collaborating with software research and development...


  • Pune, Maharashtra, India Talentmatics Full time

    Job DescriptionTalentmatics is seeking an experienced Big Data Engineer to optimize our big data platform in Pune and Hyderabad locations.We offer a competitive salary of ₹1,200,000 per annum, commensurate with experience, to manage and maintain our big data ecosystem.About the RoleThis is an exciting opportunity to work on secured environments using...

  • Big Data Engineer

    1 month ago


    Pune, Maharashtra, India Avaloq Full time

    About the Role:We're looking for a skilled Big Data Engineer to join our team at Avaloq and help shape the next generation of our data solutions for Wealth Management and Banking.Your Key Responsibilities:Create scalable and reliable data pipelines that ingest, process, and deliver data from various sources to our real-time data platform.Closely collaborate...


  • Pune, Maharashtra, India Wipro Full time

    Job Title: Data Engineering Lead - Big Data Platform ArchitectAre you an experienced data engineering professional looking to take your career to the next level? We are seeking a skilled Data Engineering Lead - Big Data Platform Architect to join our team at Wipro.Estimated Salary: ₹20,00,000 - ₹30,00,000 per annumWe offer a highly competitive salary...


  • Pune, Maharashtra, India PubMatic Full time

    About the RoleWe are seeking an experienced Senior Software Development Engineer to join our team in designing, developing, and testing complex engineering projects. The ideal candidate will have a strong background in software development, testing methodologies, and big data technologies.Key ResponsibilitiesDevelop automation frameworks using Python to...


  • Pune, Maharashtra, India Radical Technologies Full time

    **Job Title:** Cloud Computing Engineer with Big Data Experience**Company Overview:** Radical Technologies is a cutting-edge company that empowers innovation through data-driven solutions.**Salary:** ₹25,00,000 - ₹40,00,000 per annum based on experience and qualifications.**Job Description:We are seeking an experienced Cloud Computing Engineer to join...


  • Pune, Maharashtra, India Tata Consultancy Services Full time

    About the RoleWe are seeking a highly skilled Senior Data Pipeline Engineer to join our team in Pune, Hyderabad, Bangalore, Chennai, Noida or Nagpur. The ideal candidate will have 5-10 years of experience in designing and building production data pipelines using Cloud Native GCP, Python, SQL and other relevant technologies.Key ResponsibilitiesDesign and...


  • Pune, Maharashtra, India Data Axle Full time

    About Data Axle:Data Axle Inc. is a 50-year-old industry leader in data, marketing solutions, sales, and research in the US.We have set up a strategic global centre of excellence in Pune, delivering mission-critical data services to our global customers powered by our proprietary cloud-based technology platform and leveraging our proprietary business &...