Automation Expert for Data Pipelines

2 days ago


Shimoga, Karnataka, India beBeeAutomation Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

Job Summary:

We are seeking an expert in data automation to join our team.

In this role, you will be responsible for designing and developing automated scripts in Python to create a golden model within SQL Server for use in test automation.

You will collaborate with developers and analysts to understand data requirements and ensure test coverage.

Main Responsibilities:

  • Design and develop automated scripts in Python to create a golden model within SQL Server.
  • Collaborate with developers and analysts to understand data requirements and ensure test coverage.
  • Integrate testing into CI/CD pipelines to support continuous delivery and deployment.
  • Identify, document, and track defects and inconsistencies in data.
  • Contribute to test automation strategies and reusable SQL test frameworks.

Required Skills & Qualifications:

  • Strong experience in Test Automation with a focus on data validation and transformation logic.
  • Proficiency in Python, particularly with any of the below frameworks: YData-Synthetic / SDV (Synthetic Data Vault) / Gretel-Synthetics / SynthCity / DoppelGANger.
  • Experience working in CI/CD environments and integrating tests into automated pipelines.
  • Solid understanding of relational databases and data warehousing concepts.
  • Excellent analytical and problem-solving skills.
  • MUST HAVE experience with GE Plant Applications.
  • Nice to have experience with MS SQL Server.

About the Role:

  • This is a 100% remote position.
  • Candidates can be nearshore or offshore, and can overlap 3-5 hours with CST time zone.

What We're Looking For:

  • A detail-oriented and highly skilled automation expert.
  • An individual with strong experience in Test Automation and proficiency in Python.


  • Shimoga, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 21,00,000

    Job Title: Data Engineer - Cloud ExpertWe are seeking a skilled Data Engineer to join our team as a Freelance Cloud Expert. This is an exciting opportunity for a talented professional with expertise in cloud-based data engineering to contribute to the design, development, and optimization of large-scale data pipelines.This role involves working closely with...


  • Shimoga, Karnataka, India beBeeDataEngineer Full time ₹ 25,17,500 - ₹ 25,45,000

    ETL/ Database Engineer / Tester Position">We are seeking an experienced professional to design, develop and implement ETL processes and data pipelines.The ideal candidate will have a strong understanding of ETL concepts and data warehouse testing methodologies. They should be proficient in RDBMS: MySQL, Oracle SQL, and have hands-on experience with SSIS (SQL...


  • Shimoga, Karnataka, India beBeeAutomation Full time US$ 80,000 - US$ 1,40,000

    Key Roles and Responsibilities:Establish and enforce governance standards across large-scale organizations to ensure best practices are consistently applied.We are seeking a skilled expert to develop and implement automation solutions that integrate with GitHub and CI/CD pipelines. The ideal candidate will have strong Python skills, particularly in testing...


  • Shimoga, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    **Role:** Data EngineerWe are seeking an experienced professional to design and implement scalable data pipelines using Microsoft Fabric, including Dataflows Gen2, Lakehouse, Notebooks, and SQL endpoints.Develop ETL/ELT solutions using PySpark, T-SQL, and Spark Notebooks within Fabric and Azure Synapse.Manage and optimize data storage and compute in OneLake...


  • Shimoga, Karnataka, India beBeeAutomation Full time ₹ 18,00,000 - ₹ 21,00,000

    Job Title: Infrastructure Automation ExpertAs an automation expert, you will be responsible for streamlining IT infrastructure processes using specialized tools. This role requires a solid foundation in technical disciplines such as DevOps, cloud computing, and software development.Key Responsibilities:Develop and maintain automated deployment pipelines to...


  • Shimoga, Karnataka, India beBeeDataPipeline Full time ₹ 10,00,000 - ₹ 19,99,999

    Job Title: Teradata Data Pipeline DeveloperWe are seeking a skilled Teradata data pipeline developer to design, build, and optimize efficient data pipelines.Key Responsibilities:Design and develop ETL jobs using IBM DataStage and Teradata.Write optimized SQL queries for data extraction, transformation, and validation.Collaborate with data analysts and...


  • Shimoga, Karnataka, India beBeeDataPipeline Full time ₹ 15,00,000 - ₹ 20,00,000

    Expert Data Pipeline Developer Design, implement and deploy large-scale data pipelines on cloud infrastructure using services such as Amazon S3, AWS Glue, Lambda and Redshift.Develop data processing and transformation workflows using Apache Spark and SQL to support analytics and reporting requirements.Build and maintain orchestration workflows to automate...


  • Shimoga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    At ThreatXIntel, we are dedicated to protecting businesses and organizations from cyber threats. Our proactive approach to security involves continuously monitoring and testing digital environments to identify vulnerabilities.We are seeking an experienced Azure Data Factory (ADF) Specialist to support our data integration and ETL needs. The ideal consultant...


  • Shimoga, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineering ExpertWe are seeking an experienced data engineering expert to join our product engineering team at a leading company.As a key member, you will be responsible for designing, developing, and maintaining data pipelines and ETL processes using AWS services. You will work with SQL databases for data modeling, queries, and performance...


  • Shimoga, Karnataka, India beBeeAutomation Full time ₹ 8,00,000 - ₹ 12,00,000

    RPA Automation ExpertWe are seeking a seasoned RPA Automation Expert to manage end-to-end UiPath automation pipelines, integrate DevOps practices, and ensure deployment, monitoring, and operational stability across Orchestrator and AWS.Key Responsibilities:Deploy and manage UiPath bots, assets, and versions across Dev/UAT/Prod environments.Configure and...