Data Engineer

6 days ago

Ahmedabad, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

About Us

">
We are a leading provider of data-driven solutions, leveraging cutting-edge technologies to drive innovation and enhance our business processes. Our expertise spans data science, big data, enterprise cloud, and automation, making us the ideal partner for organizations seeking to unlock the full potential of their data.">

Job Summary

">
  • ">
  • Convert Teradata ETL workloads into Databricks SQL workflows.">
  • Refactor ingestion pipelines using SQL and/or Python scripts.">
  • Design and implement data validation frameworks for side-by-side comparisons.">
  • Configure orchestration and job scheduling within the Databricks environment.">
  • Perform unit, integration, UAT, and performance testing for migrated code.">
  • Validate data consistency between Teradata and Databricks environments.">
  • Execute jobs in UAT/QA, analyze data discrepancies, and provide timely resolutions.">
  • Deploy workloads in Unity Catalog enabled workspaces and ensure governance best practices.">
  • Implement job monitoring using Databricks-native tools (system tables, workflows).">
  • Collaborate with cross-functional stakeholders in enterprise-scale projects.">
">

Required Technical Skills:

">
  • ">
  • Strong expertise in Teradata ETL development & migration.">
  • Proficiency in Azure Databricks, SQL, and Python programming languages.">
  • Deep understanding of orchestration, scheduling, and data validation techniques.">
  • Hands-on knowledge of Unity Catalog for permissions and governance.">
  • Solid experience in data testing: unit, integration, UAT, and performance.">
  • Strong troubleshooting, debugging, and optimization skills.">
  • Familiarity with cloud environments (Azure/AWS/GCP).">
">

Proven Experience In:

">
  • ">
  • Migrating large-scale Teradata workloads to Databricks.">
  • Implementing data validation frameworks and resolving data drift.">
  • Executing side-by-side data comparisons between legacy and modern systems.">
  • Applying performance tuning techniques for query and job optimization.">
  • Collaborating with cross-functional stakeholders in enterprise-scale projects.">

  • Senior Administration Executive

    1 week ago

    Ahmedabad, Gujarat, India Technobeat Engineer Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    We are seeking a dedicated Senior Admin Executive. The role is to manage and preparation of reports, ensure accuracy, and maintain monthly documentation. Responsible for collecting data from engineers, guiding team in report creation, and submission.

  • Senior Software Engineer/Technical Lead

    1 week ago

    Ahmedabad, Gujarat, India Crest Data Full time US$ 90,000 - US$ 1,20,000 per year

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Lead Engineer

    1 week ago

    Ahmedabad, Gujarat, India Crest Data Systems Full time

    Role : ReactJS Lead EngineerWe are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data Responsibilities :- Responsible for providing expertise in software development life...

  • Anblicks - Lead Data Engineer - Snowflake Migration

    1 week ago

    Ahmedabad, Gujarat, India ANBLICKS CLOUD DATA ENGG PRIVATE LIMITED Full time

    Job Title : Lead Data Engineer Snowflake MigrationLocation : Hyderabad / AhmedabadExperience : 7+ YearsBe a Trailblazer in Our Data Modernization Center of Excellence (COE)At Anblicks, we are on a mission to modernize legacy data ecosystems and help enterprises unlock the power of the cloud. Our Data Modernization COE is at the forefront of this...

  • Data engineer

    2 weeks ago

    Ahmedabad, Gujarat, India NP Group Full time

    Data Engineer - Python, Pyspark & Palantir FoundryFully Remote 6 month full time contractRate: $13.00 - $15.00 per hourWe have an immediate requirement for an experienced Data Engineer to join the global engineering team for a International Enterprise Organisation.You will bring Data Engineering expertise onto greenfield multi year project initiative.You...

  • Data Engineer

    1 week ago

    Ahmedabad, Gujarat, India ANS Group Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    At ANS, we empower businesses to harness the full potential of their data through cutting-edge cloud and data technologies. As aData Engineer, you'll be at the heart of this mission—designing, building, and optimizing data solutions that drive real impact for our customers.This role sits in our Centre of Excellence team, which is an innovative hub...

  • Data Engineer

    5 days ago

    Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Unlock Your Career in Data EngineeringWe are seeking an experienced data engineer to design, build, and maintain robust data pipelines. Key ResponsibilitiesData Pipeline Development:Curate and ingest data efficiently using cloud-based solutions.Azure Cloud Services:Deploy and manage scalable data solutions using Azure Data Factory, Databricks, Synapse, and...

  • Senior Software Engineer/Technical Lead

    1 day ago

    Ahmedabad, Gujarat, India Crest Data Systems Full time

    Company Overview :Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics.The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Senior Software Engineer/Technical Lead

    1 week ago

    Ahmedabad, Gujarat, India Crest Data Systems Full time

    Company Overview :Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics.The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Data Engineer

    1 week ago

    Ahmedabad, Gujarat, India ServoEdge Technologies Full time US$ 90,000 - US$ 1,20,000 per year

    Role: Data Engineer (3 to 5 Yrs of Experience) :Location: AhmedabadMustHave - Deep knowledge of Azure stack, especially SynapseAsa Data Engineer, you'll be at the heart of this mission—designing,building, and optimizing data solutions that drive real impact for ourcustomers.Thisrole sits in our Centre of Excellence team, which is an innovative hubdedicated...