Advanced Data Solutions Engineer

2 days ago

Meerut, Uttar Pradesh, India beBeeDataSolutions Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

Job Opportunity:

Data Solutions Developer

We are seeking a skilled Databricks PySpark Developer to join our team. In this role, you will be instrumental in designing and implementing ETL processes to ensure efficient extraction, transformation, and loading of data from various sources into a data lake and warehouse.

Key Responsibilities:

  • ETL Process Design:
  • Design and develop ETL processes using Databricks PySpark to extract, transform, and load data from heterogeneous sources.
  • Workflow Optimization:
  • Optimize ETL workflows for performance and scalability, leveraging Databricks PySpark and Spark SQL to efficiently process large data volumes.
  • Error Handling and Monitoring:
  • Implement robust error handling and monitoring mechanisms to proactively detect and resolve issues within ETL processes.
  • Data Solution Development:
  • Design and implement data solutions following the Medallion Architecture principles, organizing data into Bronze, Silver, and Gold layers.

Required Skills:

  • Bachelor's degree in Computer Science or a related field.
  • Minimum 3 years of experience as an ETL developer, with a strong focus on Databricks PySpark development.
  • Proficiency in Python programming, with extensive experience in developing and debugging Databricks PySpark applications.
  • In-depth understanding of Spark architecture and internals, with hands-on experience in Spark RDDs, DataFrames, and Spark SQL.

Preferred Qualifications:

  • Experience with cloud platforms.
  • Experience with data platform tools such as Databricks, Snowflake, and Tableau.
  • Demonstrated ability to implement best practices for ETL processes and data management.

Benefits:

This is a great opportunity to work with a talented team and contribute to the development of advanced data solutions.

About Us:

We are committed to fostering a collaborative and innovative work environment that encourages growth and professional development.

  • Advanced Data Engineer

    2 days ago

    Meerut, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Overview:We are seeking an experienced data professional to design and implement scalable, high-performance data pipelines using AWS cloud services and Databricks. The ideal candidate will have a strong background in data engineering, data warehousing, and big data frameworks.Main Responsibilities:Design, develop, and maintain data pipelines and...

  • DATA Solution Architect

    3 weeks ago

    Meerut, Uttar Pradesh, India Blue Cloud Softech Solutions Limited Full time

    Solution Architect – Data Platforms & Solution DeliveryExperience: Minimum 7+ years in solution/data architecture and large-scale implementationsDepartment: DIA – Architecture teamRole SummaryWe are seeking an experienced Solution Architect to drive the design and delivery of enterprise data and analytics solutions. You will work closely with business...

  • Senior Data Solutions Engineer

    1 day ago

    Meerut, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 23,00,000

    Role OverviewWe are seeking a skilled data engineer to join our team. This individual will be responsible for designing and implementing data solutions that drive business growth.

  • Senior Data Engineer

    2 days ago

    Meerut, Uttar Pradesh, India EXL Full time

    Job Summary:We are seeking an experienced Data Engineer with strong expertise in AWS cloud services and Databricks to design and implement scalable, high-performance data pipelines. The role involves building and optimizing ETL/ELT workflows, managing big data environments, and ensuring seamless data availability for analytics, AI/ML, and business...

  • Advanced Data Engineer Position

    1 day ago

    Meerut, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Summary:We are seeking a highly skilled Data Engineering professional to join our organization. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable data processing pipelines using PySpark and HiveDevelop and...

  • AI Engineer

    2 days ago

    Meerut, Uttar Pradesh, India beBeeAutomation Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: AI Engineer - Automation Solutions", This role involves the design, development, and deployment of AI-powered automation solutions to enhance business processes and self-service applications. ", The ideal candidate will have a strong understanding of AI/ML concepts, proficiency in Python, Java, or other relevant programming languages, and...

  • Data Architect and Engineer

    7 days ago

    Meerut, Uttar Pradesh, India beBeeSnowflake Full time ₹ 15,00,000 - ₹ 25,00,000

    Snowflake Developer and Infrastructure ExpertWe're seeking an accomplished professional to spearhead full lifecycle implementations, from secure platform setup and cloud integration to high-performance data pipeline development.This role combines data engineering, infrastructure, and DevOps expertise for enterprise-grade analytics and AI projects. Design and...

  • Senior Data Extraction Engineer

    4 days ago

    Meerut, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Advanced Web Scraping Specialist">We are seeking a highly skilled and experienced web scraping professional to drive our data extraction operations forward. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers.">About the Role:">Design and develop scalable data...

  • Data Architectural Engineer

    1 day ago

    Meerut, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Unlock the Power of Data EngineeringAs a seasoned data engineer, you will play a pivotal role in unlocking the strategic drivers for future success. Our advanced analytics team is dedicated to solving complex problems and driving topline growth and operational efficiencies.Analyze existing data warehouse implementations to support migration and consolidation...

  • Senior Data Systems Engineer

    2 days ago

    Meerut, Uttar Pradesh, India beBeeData Full time ₹ 12,00,000 - ₹ 25,00,000

    Job Title: Data ArchitectAbout the Role:We are looking for a highly skilled and experienced Data Architect to join our team. As a Data Architect, you will be responsible for designing and developing scalable data pipelines and infrastructure that support real-time and batch data processing.Your key responsibilities will include:Designing robust data...