Data Pipeline Architect

2 days ago


Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000
Expert Data Engineer Wanted

We are seeking a highly skilled and experienced Data Engineer to design and develop scalable data pipelines using Spark technology.

Key Responsibilities:
  • Develop efficient and scalable data processing pipelines using Apache Spark
  • Design and implement robust frameworks for generating reports using Python and Spark
  • Utilize Snowflake SQL to perform high-performance aggregations on large datasets
  • Develop stored procedures, views, indexes, triggers, and functions in Snowflake Database to maintain data integrity and share with downstream applications via APIs
Requirements:
  • Proven experience as a Data Engineer with expertise in data pipeline architecture and ETL processes
  • Proficiency in Python with experience in data manipulation libraries such as Pandas and NumPy
  • Experience with SQL and Snowflake for querying and aggregating large datasets
  • Familiarity with Azure cloud services including Data Factory, Databricks, and Datalake
Why Choose Us?
  • Collaborate with industry leaders on cutting-edge projects
  • Enjoy accelerated career growth and global exposure opportunities
  • Work in an innovative and inclusive environment that fosters creativity
Essential Skills:
  • Python
  • SQL
  • Spark
  • Azure Data Factory
  • Azure Datalake
  • Azure Databricks


  • Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    We are seeking a highly motivated and experienced Data Engineer to lead the design, build, and maintenance of robust data pipelines. The ideal candidate will have deep expertise in cloud-based data processing technologies using GCP, AWS, or Azure.Responsibilities:Create scalable data pipelines using cloud services (GCP, AWS, or Azure).Implement data...


  • Dindigul, Tamil Nadu, India beBeeComputer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Computer Vision EngineerWe are seeking an accomplished Senior Computer Vision Engineer to spearhead the design and implementation of sophisticated CV pipelines. The ideal candidate will have 6-10 years of experience in architecting and deploying CV systems, with expertise in multi-object tracking, object detection, semi/unsupervised learning, and...


  • Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data Engineer">About the PositionWe are seeking a highly skilled data engineer with expertise in Microsoft Azure to design, build, and optimize scalable data pipelines and architectures. This role involves collaborating with cross-functional teams to develop and implement data-driven solutions that meet business needs.Key...


  • Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 18,00,000

    About This RoleWe are looking for a skilled Data Architect to design and implement scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.Key Responsibilities:Collaborate with cross-functional teams to develop high-quality data solutions.Design and deploy efficient ETL/ELT pipelines with Azure Databricks by utilizing PySpark and...


  • Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 22,00,000

    Job OverviewThe role of Data Engineer is a critical component in the design and implementation of high-performance data pipelines. Our ideal candidate will possess extensive knowledge of AWS cloud services, Databricks, and Python/SQL for data transformation.


  • Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OpportunityWe are seeking a skilled Senior Data Engineer to take on the challenge of building and maintaining our data pipelines.Responsibilities:Develop ETL pipelines using FiveTran, DBT Cloud, and custom frameworksImplement client-specific data transformations for HighTouch integrationSupport data ingestion and quality checks during client...


  • Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Cloud Data Architect">About the Role:">We are seeking an experienced cloud data architect with a strong background in designing and implementing scalable, high-performance data solutions on Databricks.">The ideal candidate has hands-on experience in Databricks production environments and a deep understanding of modern data architecture.">You will...


  • Dindigul, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Description:We are seeking a highly skilled Data Architect to design and implement a scalable data platform leveraging modern technologies.The ideal candidate has a strong foundation in SQL engineering, cloud data architectures, and modern data pipelines. Experience with hosted data warehouse platforms is a plus.Key Responsibilities:Design and build a...


  • Dindigul, Tamil Nadu, India beBeeSoftwareEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking an experienced professional to drive testing strategy and execution for a project leveraging Databricks, Data Factory pipelines and Power BI. The ideal candidate will have expertise in testing data pipelines using Python, SQL, etc. along with experience in JIRA test management. Additionally, the role requires experience with GitHub/Bitbucket...

  • Data Architect

    22 hours ago


    Dindigul, Tamil Nadu, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Opportunity:We are seeking an experienced Data Architect to join our organization. As a Data Architect, you will be responsible for designing and implementing scalable data transformation pipelines using Snowflake and dbt.Key Responsibilities:Develop data architectures that follow industry-accepted best practices.Design ingestion pipelines from various...