Data Engineering Expert

22 hours ago

Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 16,00,000 - ₹ 2,02,50,000
About This Role

We're looking for a skilled professional to drive our data engineering efforts forward.

This role is focused on developing and implementing modern data warehouse solutions using Snowflake and ADF, as well as providing forward-thinking solutions in the data engineering and analytics space.

The ideal candidate will have expertise in Snowflake security, Snowflake SQL, and designing/implementing other Snowflake objects.

Additionally, they should have hands-on experience with Snowflake utilities, SnowSQL, Snowpipe, Snowsight, and Snowflake connectors.

A deep understanding of star and snowflake dimensional modeling is also required.

The selected candidate will work closely with DW/BI leads to understand new ETL pipeline development requirements and collaborate with business teams to develop a data model to fulfill reporting needs.

Responsibilities:

  • Develop Modern Data Warehouse solutions using Snowflake and ADF.
  • Provide solutions that are forward-thinking in data engineering and analytics space.
  • Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
  • Triage issues to find gaps in existing pipelines and fix the issues.
  • Work with business to understand the need in the reporting layer and develop a data model to fulfill reporting needs.
  • Help joiner team members to resolve issues and technical challenges.
  • Drive technical discussions with client architect and team members.
  • Orchestrate the data pipelines in the scheduler via Airflow.

Qualifications:

  • Bachelor's and/or master's degree in computer science or equivalent experience.
  • Total 6+ years' IT experience and 3+ years' experience in Data warehouse/ETL projects.

Benefits:

  • Strong knowledge of Data Management principles.
  • Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture.
  • Hands-on experience in SQL and Spark (PySpark).
  • Experience in building ETL / data warehouse transformation processes.
  • Experience working with structured and unstructured data including imaging & geospatial data.
  • Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

Preferred Skills:

  • Snowflake/Azure Data Factory/ PySpark.

  • Big Data Engineer

    17 hours ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data Engineering RoleWe are looking for a skilled Big Data Engineer to lead our team in delivering scalable and efficient data infrastructure. The ideal candidate will have expertise in Cloudera and Linux commands, as well as strong knowledge of data migration, performance tuning, and application deployment.Key Responsibilities:Design and manage...

  • Data Engineer

    1 day ago

    Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineer - Oil and Gas Expertise Job Summary: We are seeking an experienced Data Engineer with oil and gas industry expertise to design, build, and optimize scalable data pipelines and cloud solutions. The ideal candidate will have strong experience in AWS cloud services, data engineering, and knowledge of oil and gas upstream, midstream, or...

  • Data Migration Expert

    2 days ago

    Vellore, Tamil Nadu, India beBeeDataMigration Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Migration ExpertWe are seeking a seasoned Data Migration Specialist to lead our data migration efforts. The ideal candidate will have extensive experience in developing and executing data migration strategies, as well as collaborating with cross-functional teams to drive project success.

  • Data Engineer

    3 weeks ago

    Vellore, Tamil Nadu, India Marktine Technology Solutions Pvt Ltd Full time

    Position: Senior Data EngineerExp: 12-15 YearsLocation: RemoteWe are seeking a Senior Data Engineer. The ideal candidate will be based in India and work remotely. This role requires a blend of design and implementation expertise.Key Responsibilities:Design and bootstrap data solutions, including setting up Snowflake for a large, complex conglomerate.Utilize...

  • Data Analyst Expert

    1 day ago

    Vellore, Tamil Nadu, India beBeeData Full time US$ 9,00,000 - US$ 12,00,000

    Data Analyst ExpertWe are seeking a seasoned Data Analyst to leverage data, analytics, and AI technologies to drive business growth and extract valuable insights. The ideal candidate will have extensive experience in data analysis, machine learning, and statistical modeling.The successful candidate will possess a strong background in optimization...

  • Data Engineer

    1 day ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data ProfessionalAs a senior data engineer at a leading technology firm, you will be responsible for working with large-scale data sets to uncover valuable insights and inform business decisions.Key Responsibilities:Develop and maintain scalable big data architectures using distributed processing frameworks and data warehousing solutions.Collaborate with...

  • Cloud Architect

    6 days ago

    Vellore, Tamil Nadu, India beBeeData Full time US$ 1,50,000 - US$ 1,70,000

    Cloud Integration Data EngineerWe are seeking an experienced Cloud Integration Data Engineer to join our team. The ideal candidate will have a strong background in designing, building and maintaining scalable data pipelines using cloud-based technologies.The successful candidate will lead the integration strategy for ingesting and harmonizing data from...

  • Lead Data Engineer

    1 day ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Opportunity: Data EngineerWe are seeking a highly skilled Data Engineer to join our team. As a key member of the data engineering team, you will be responsible for designing and developing scalable data pipelines using PySpark.The ideal candidate will have hands-on expertise in building complex business logic using Spark SQL, DataFrame, and RDD APIs.A...

  • Cloud Data Engineer

    4 days ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data EngineerJob Summary:We are seeking a skilled Cloud Data Engineer with expertise in CI/CD and Kubernetes to develop scalable data ingestion workflows.The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support efficient ingestion processes.Key Responsibilities:Design, develop, and...

  • Expert Data Architect

    2 days ago

    Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data Engineer Job DescriptionThe role of Senior Data Engineer involves overseeing the development and implementation of scalable data processing workflows using Azure Databricks, PySpark, and Apache Spark.Key Responsibilities:Data Processing Workflow Development: Develop real-time and batch processing workflows that are scalable, efficient, and...