Senior Data Solutions Engineer

5 days ago

Davangere, Karnataka, India beBeeDataEngineering Full time ₹ 13,00,000 - ₹ 20,10,000

Job Title: Data Architect

 

We are seeking a highly skilled professional with expertise in designing, building, and optimizing scalable data pipelines. The ideal candidate will have hands-on experience working with Databricks, managing large-scale data processing workflows, and implementing data transformation workflows using PySpark and Scala Spark.

 

Key Responsibilities:

  • Design, develop, and maintain efficient ETL pipelines for batch data ingestion and egress using Azure Data Factory, Databricks, and Spark.
  • Implement data transformation workflows using PySpark and Scala Spark for high-performance data processing.
  • Work extensively with Azure Cloud services including Azure Data Lake, Azure Data Factory, Azure Databricks, Azure SQL Database, and related services.
  • Troubleshoot, debug, and resolve job failures by identifying root causes.
  • Optimize data processing jobs for performance and cost efficiency.
  • Collaborate with business and technical teams to gather requirements and translate them into effective data solutions.
  • Develop reusable and efficient data engineering solutions following best practices.
  • Maintain detailed documentation for solutions, processes, and troubleshooting guides.

 

Technical Skills Required:

  • Strong programming skills in Python and Scala.
  • Hands-on experience with Spark (PySpark & Scala Spark).
  • Proficiency in SQL for data querying and transformation.
  • Good knowledge of Azure Cloud, Azure Data Factory (ADF), and Azure Databricks.
  • Strong understanding of ETL pipeline design and implementation.
  • Proven ability to troubleshoot jobs and analyze root causes effectively.

 

Why Join Us:

This is an exciting opportunity to join our team as a Data Architect. You will be part of a collaborative environment where you can grow professionally, work on challenging projects, and make a meaningful impact on our organization.

 

What We Offer:

We offer a competitive salary package, comprehensive benefits, and opportunities for career growth and development. Our company values innovation, teamwork, and excellence, and we seek individuals who share these values.

  • Senior Data Solutions Developer

    5 days ago

    Davangere, Karnataka, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Senior Data Solutions DeveloperA leading retail and e-commerce organization is seeking a seasoned Senior Data Solutions Developer to join their team. This individual will be responsible for designing, developing, and automating large-scale data workflows using Python and Pandas.Key Responsibilities:Develop and implement ETL pipelines using Python...

  • Senior Data Engineering Expert

    5 days ago

    Davangere, Karnataka, India beBeeDataEngineering Full time US$ 1,50,000 - US$ 2,50,000

    Job Title:Senior Data Engineering Expert">About the Role:We are seeking a seasoned Senior Data Engineer to lead the design and implementation of high-quality, secure, and scalable data pipelines and systems.This role requires 4–5 years of experience in data engineering with expertise in designing complex data architectures and developing efficient data...

  • Senior Cloud Data Solutions Architect

    1 day ago

    Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,50,00,000

    Cloud Data Engineer RoleThis is a senior-level position focused on leading the design and implementation of scalable data engineering solutions on Google Cloud Platform.The ideal candidate will have a strong passion for cloud-based projects and a deep background in Big Data Analytics solutions.Key Responsibilities:Data Pipeline DevelopmentDesign, build, and...

  • Senior Data Engineer

    5 days ago

    Davangere, Karnataka, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 24,00,000

    Job Title: Business Intelligence SpecialistLocation: GlobalJob Type: ContractYears of Experience: 6–9 yearsA leading organization is seeking a highly skilled Business Intelligence Specialist with a strong focus on data engineering and reporting solutions to support enterprise data initiatives from offshore. This role combines hands-on data engineering and...

  • Senior Data Solutions Architect

    6 days ago

    Davangere, Karnataka, India beBeeDataSolutionsArchitect Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data Solutions Architect">We are seeking a seasoned Data Solutions Architect to lead multiple data engagements on GCP Cloud for data lakes, data engineering, data migration, data warehouse, and business intelligence. As a senior team member, you will be responsible for driving the success of our data-related projects.">About the Role">This...

  • Senior Data Scraping Engineer

    7 hours ago

    Davangere, Karnataka, India beBeeDataScraping Full time

    Job Title: Senior Data Scraping EngineerLocation: RemoteExperience Level: Senior (4+ years)Employment Type: Full-timeOverviewWe are seeking a highly skilled and experienced Data Scraping Engineer to lead our team. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+...

  • Senior Data Engineering Expert

    1 day ago

    Davangere, Karnataka, India beBeeDataEngineering Full time US$ 1,20,000 - US$ 2,00,000

    Job Overview:We are seeking a seasoned Senior Data Engineer with deep expertise in AWS Cloud Development to lead the development of new data products and modernization of existing platforms.This individual will design, build, and optimize large-scale data pipelines and architectures in both on-premises environments (e.g., Oracle) and cloud environments...

  • Senior Data Engineer

    5 days ago

    Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000

    Job OverviewThe Power BI Engineer role is a key position within our organization, responsible for developing insightful reports that transform assessment data into actionable intelligence for both internal teams and external clients.This engineer will work closely with data from Talogy's Talent Measurement platform, creating visualizations that bring clarity...

  • Senior Cloud Data Engineer

    3 days ago

    Davangere, Karnataka, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering Leader As a senior data engineering professional, you will play a key role in driving the development of our innovative data warehouse offerings. Key Responsibilities:Lead a team of senior data engineers to design and develop cloud-native data-intensive applicationsCollaborate with cross-functional teams to architect and...

  • Data Engineer Leader

    1 day ago

    Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,01,00,000

    Job Title: Data Engineer LeaderWe are seeking a seasoned Senior Data Engineer to join our team.The ideal candidate will have 5+ years of experience in data engineering, with a strong background in Azure and AWS Databricks. Expertise in Python, Scala, Spark, Pyspark, HIVE, HBase, Impala, and Parquet is required.Strong SQL and RDBMS skills, as well as...