Senior Data Solutions Engineer

1 day ago

Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

We are seeking a highly skilled data professional with 4+ years of experience in Azure data engineering, boasting strong expertise in Python, Scala, Spark (PySpark & Scala Spark), and Azure Cloud technologies. The ideal candidate will have hands-on experience designing, building, and optimizing ETL pipelines, working with Databricks, and managing large-scale data processing workflows.

Key Responsibilities

  • Design, develop, and maintain scalable ETL pipelines for batch data ingestion and egress using Azure Data Factory, Databricks, and Spark.
  • Implement data transformation workflows using PySpark and Scala Spark for high-performance data processing.
  • Work extensively with Azure Cloud services including Azure Data Lake, Azure Data Factory, Azure Databricks, Azure SQL Database, and related services.
  • Troubleshoot, debug, and resolve job failures by identifying root causes.
  • Optimize data processing jobs for performance and cost efficiency.
  • Collaborate with business and technical teams to gather requirements and translate them into effective data solutions.
  • Develop reusable and efficient data engineering solutions following best practices.
  • Maintain detailed documentation for solutions, processes, and troubleshooting guides.

Technical Skills Required

  • Strong programming skills in Python and Scala.
  • Hands-on experience with Spark (PySpark & Scala Spark).
  • Proficiency in SQL for data querying and transformation.
  • Good knowledge of Azure Cloud, Azure Data Factory (ADF), and Azure Databricks.
  • Strong understanding of ETL pipeline design and implementation.
  • Proven ability to troubleshoot jobs and analyze root causes effectively.

  • Strategic Data Solutions Engineer

    2 days ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Overview:We are seeking a seasoned Senior Data Engineer to design and optimize data solutions for analytics, reporting, and strategic initiatives in the financial industry.The ideal candidate will have deep expertise in ETL development, data modeling, and financial data domains, particularly within credit unions and banking systems.Key...

  • Senior Data Engineer

    3 days ago

    Erode, Tamil Nadu, India Collabera Full time

    Senior Data EngineerArrangement: Fully RemoteShift: US Time Zone (Night Shift)Industry: Financial Institution (FI) - Credit UnionJob SummaryCollabera is seeking a seasoned Senior Data Engineer for its leading financial customer to design and optimize data solutions that power our analytics, reporting, and Member 360 initiatives. This role is ideal for...

  • Senior Big Data Engineer

    4 days ago

    Erode, Tamil Nadu, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Big Data EngineerThe Role:We are seeking an experienced Senior Big Data Engineer to join our team. The ideal candidate will have a strong background in designing, developing, and maintaining large-scale data processing systems using big data technologies.Key Responsibilities:Design and develop scalable and efficient data processing systems using big...

  • Advanced Data Solutions Specialist

    2 days ago

    Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer PositionWe are seeking a skilled Senior Data Engineer to join our team and contribute to the development of a FinTech application designed to scale and meet the needs of our users.The ideal candidate will have 4-8 years of experience in data engineering, with expertise in Azure Databricks, SQL, Python, Py-spark, and Automation. Knowledge...

  • Senior Data Engineer

    3 days ago

    Erode, Tamil Nadu, India Right Move Full time

    Greetings From Right Move Please see below the Job Description. If you find this interesting and in line with your career aspirations, kindly revert to this email with your confirmation & updated CV.Experience – 4+ Years.Role –Senior Data Engineer .Job Type - Permanent.Mode – Work from Office.Company Location – Pune .Only IIT Candidates Skill Set –...

  • Senior Data Engineering Leader

    2 days ago

    Erode, Tamil Nadu, India beBeeDataEngineer Full time US$ 2,00,000 - US$ 2,50,000

    About Our Role">We are seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering department, you will play a critical role in designing and implementing large-scale data pipelines that drive business growth and innovation.

  • Senior Cloud Data Engineer

    21 hours ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title:A seasoned data engineering professional with expertise in designing and implementing serverless data ingestion and transformation solutions using AWS Glue.About the Role:We are seeking a highly skilled Senior AWS Glue Developer to join our team. As a key member of our data engineering team, you will be responsible for creating scalable and...

  • Senior Data Solutions Architect

    4 days ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Unlock Career Potential in Data EngineeringAs a seasoned Databricks Engineer, you will design, develop, and maintain sophisticated data pipelines and ETL processes on Databricks. Your expertise will be pivotal in shaping the architecture and implementation of scalable, secure, and high-performance data solutions.The role involves collaborating with business...

  • Senior Data Engineering Expert

    2 days ago

    Erode, Tamil Nadu, India beBeeDataEngineering Full time US$ 36,100 - US$ 96,100

    Data Solutions EngineerWe are seeking a seasoned Data Solutions Engineer to design and implement scalable data pipelines using Palantir Foundry, PySpark, and Typescript.This includes developing robust data integration solutions with various data sources and ensuring high-quality data governance.The ideal candidate will have extensive experience in Palantir...

  • Senior Data Engineer

    4 days ago

    Erode, Tamil Nadu, India beBeeEngineering Full time ₹ 25,00,000 - ₹ 30,00,000

    Strategic Data Engineering ManagerThis is a senior-level data engineering management position that requires extensive experience in Big Data platforms, cloud architecture, and team leadership.The ideal candidate will oversee the development of end-to-end data solutions using Azure Data Services and Databricks, collaborate with cross-functional teams to...