Data Engineering Professional

8 hours ago

Mount Abu, Rajasthan, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

Job Overview:

We are seeking a highly skilled data engineering professional to work in an on-premise data engineering environment.

The ideal candidate will have experience in ETL tools, data processing technologies, data orchestration, and relational databases. Additionally, you should be proficient in Python scripting for data engineering tasks and have experience working with Spark, PySpark, and other relevant data technologies.

This is an excellent opportunity to work on exciting projects that require developing scalable data pipelines, real-time data streaming, and optimizing data processing tasks using Python.

Key Responsibilities:

  • Data Pipelining & Optimization: Design, develop, and optimize data pipelines using open-source or cloud ETL tools (e.g., Apache Nifi, Talend, Pentaho, Airflow, AWS Glue).
  • Python Scripting for Data Engineering: Write Python scripts to automate data extraction, transformation, and loading (ETL) processes. Ensure that the code is optimized for performance and scalability.
  • Big Data Processing: Work with Apache Spark and PySpark to process large datasets in a distributed computing environment. Optimize Spark jobs for performance and resource efficiency.
  • Job Orchestration: Use Apache Airflow or other orchestration tools to schedule, monitor, and automate data pipeline workflows.
  • Data Streaming: Design and implement real-time data streaming solutions using technologies like Apache Kafka or AWS Kinesis for high-throughput, low-latency data processing.
  • File Formats & Table Formats: Work with open-source table formats like Apache Parquet, Apache Avro, or Delta Lake, and other structured/unstructured data formats for efficient data storage and access.
  • Database Management: Work with relational databases (e.g., PostgreSQL, MySQL, SQL Server) for data storage, management, and optimization. Understand database concepts such as normalization, indexing, and query optimization.
  • SQL Expertise: Write and optimize complex SQL queries for data extraction, transformations, and aggregation across large datasets. Ensure queries are efficient and scalable.
  • BI & Data Warehouse Knowledge: Exposure to BI tools and data warehousing concepts is a plus, ensuring the data is structured in a way that supports analytics and reporting.

  • Data Engineering Professional

    2 days ago

    Mount Abu, Rajasthan, India beBeeData Full time ₹ 12,00,000 - ₹ 25,00,000

    Job Opportunity for Data EngineersWe are seeking skilled professionals to fill the role of Data Engineer. As a key member of our team, you will be responsible for designing and implementing data pipelines using GCP technologies.Key Responsibilities:Develop and maintain large-scale data pipelines using Bigquery, SQL, and Python dataflow skills.Collaborate...

  • Senior Data Engineering Professional

    6 days ago

    Mount Abu, Rajasthan, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Overview">We are seeking an experienced professional to lead our data engineering efforts, focusing on developing and maintaining scalable data pipelines using Python and AWS.The ideal candidate will have a strong background in ETL processes, data warehousing, and modeling concepts, with experience working with large datasets and ensuring data integrity,...

  • High-Performing Data Engineering Professional

    6 days ago

    Mount Abu, Rajasthan, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    Job TitleA Data Engineering Leader is responsible for building and optimizing data pipelines, collaborating with cross-functional teams to ensure efficient data flow. This role requires a proactive leader with 6+ years of experience in data engineering, leading large-scale projects.We are seeking an expert in data warehouse architecture, dimensional...

  • Data Engineering Lead

    2 days ago

    Mount Abu, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineering LeadTransform Your Career with Us!Data Engineering Position AvailableAs a Data Engineering Lead, you will be responsible for designing and implementing data-driven solutions that drive business growth.Key Responsibilities:Maintain architecture principles, guidelines, and standards for data warehousing and big data analyticsDevelop...

  • Master Data Engineering Professional

    5 days ago

    Mount Abu, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewWe are seeking a highly skilled Data Engineer with extensive experience in designing, building, and optimizing ETL pipelines. The ideal candidate will have hands-on expertise in Azure Cloud technologies.

  • Data Engineer

    1 week ago

    Mount Abu, Rajasthan, India beBeeDataEngineer Full time ₹ 22,50,000 - ₹ 25,00,000

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team.About the RoleThis is a challenging opportunity for experienced professionals to leverage their technical skills and knowledge to design, implement, and maintain databases.Develop and execute test plans to ensure database functionality and integrity.Collaborate with...

  • Data Engineering Expert

    2 days ago

    Mount Abu, Rajasthan, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineering ExpertWe are seeking a skilled data engineering professional to design, build, and maintain robust data pipelines for processing channel activity data.The ideal candidate will have experience in digital channel activities, data engineering, and cloud technologies, particularly in AWS. They will be responsible for working on AWS...

  • Highly Skilled Data Engineering Professional

    5 days ago

    Mount Abu, Rajasthan, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data EngineerJob Title: Senior Data EngineerAbout the RoleWe are looking for a highly skilled and experienced data engineer to join our data engineering team. The successful candidate will be responsible for designing, developing, and maintaining end-to-end data integration solutions, optimizing workflows, and collaborating with business and technical...

  • Big Data Engineer

    7 days ago

    Mount Abu, Rajasthan, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    We are seeking a seasoned professional to spearhead the design and development of end-to-end data pipelines that drive business insights and scalable data solutions on the Microsoft Azure platform.Key Responsibilities:Develop, deploy and maintain complete E2E Data PipelinesManage data validation, transformation and warehousing using PySpark and...

  • Data Engineering Specialist

    2 days ago

    Mount Abu, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data EngineerWe are seeking a skilled professional to lead our data engineering initiatives.About the Role:Develop and implement scalable data pipelines using industry-leading technologies such as Microsoft Fabric, including Dataflows Gen2, Lakehouse, Notebooks, and SQL endpoints.Design and build ETL/ELT solutions using PySpark, T-SQL, and Spark...