Senior Data Solutions Engineer

1 week ago

Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000
Job Description:

Data engineers play a critical role in designing, developing and maintaining data pipelines and infrastructure. They collaborate with data scientists, analysts and other stakeholders to understand data requirements and deliver actionable insights.

Key Responsibilities:
  • Design, develop and implement data pipelines using Azure Data Factory and Databricks to support the ingestion, transformation and movement of data.
  • Develop and optimize ETL processes to ensure efficient data flow and transformation.
  • Develop and maintain Azure Data Lake solutions, ensuring efficient storage and retrieval of large datasets.
  • Work with Azure Synapse Analytics to build and manage scalable data warehousing solutions that enable advanced analytics and reporting.
  • Integrate various data sources into MS-Fabric, ensuring data consistency, quality and accessibility across different platforms.
  • Optimize data processing workflows and storage solutions to improve performance and reduce costs.
  • Manage and optimize databases (SQL and NoSQL) to support high-performance queries and data storage requirements.
  • Implement data quality checks and monitoring to ensure accuracy and consistency of data.
  • Collaborate with cross-functional teams to deliver high-quality data solutions.
  • Stay up-to-date with emerging trends and technologies in data engineering.
Qualifications:

Applicants must have 2-4 years of experience in data engineering or a related field. Key qualifications include:

  • Proficiency with Azure Data Factory, Azure Synapse Analytics, Databricks and Azure Data Lake.
  • Experience with Microsoft Fabric is a plus.
  • Strong SQL skills and experience with data warehousing concepts.
  • Knowledge of data modeling, ETL processes and data integration.
  • Experience with relational databases (e.g., MS-SQL, PostgreSQL, MySQL).
  • Hands-on experience with ETL tools and frameworks (e.g., Apache Airflow, Talend).
  • Knowledge of big data technologies (e.g., Hadoop, Spark) is a plus.
  • Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and associated data services.
  • Familiarity with data visualization tools (e.g., Power BI) and experience with programming languages such as Python, Java or Scala.
  • Experience with schema design and dimensional data modeling.
  • Strong problem-solving abilities and attention to detail.
  • Excellent verbal and written communication skills, with the ability to explain technical concepts to non-technical stakeholders.
  • Bachelor's degree in computer science, Engineering, Mathematics or a related field. Advanced degrees or certifications are a plus.

  • Senior Data Engineer

    5 days ago

    Madurai, Tamil Nadu, India beBeeDataScientist Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OverviewA Senior Data Scientist is required to develop and deploy machine learning models using Python, PyTorch, scikit-learn, and other relevant libraries.They will extract insights from complex data and communicate findings to stakeholders effectively.The ideal candidate will design and implement data-driven solutions, including real-time and batch...

  • Senior Databricks Data Engineer

    2 weeks ago

    Madurai, Tamil Nadu, India CodeVyasa Full time

    Looking for Senior Databricks Data Engineer | Pan India to join a team of rockstar developers. The candidate should have a minimum of 10+ yrs. of experience.About CodeVyasa: CodeVyasa is a mid-sized product engineering company that works with top-tier product/solutions companies such as McKinsey, Walmart, RazorPay, Swiggy, and others. We are about 550+...

  • Senior Cloud Data Solutions Architect

    6 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Role Overview:The Senior Data Engineer will collaborate with data scientists and architects to develop scalable data solutions. This role requires the ability to design and build robust data pipelines, as well as operationalize data on cloud platforms.Key Responsibilities Include:Designing and building high-quality data pipelines that support analytics and...

  • Senior Data Engineer

    2 weeks ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    About Our OpportunityWe are seeking a skilled professional to lead our data engineering efforts in solution architecture.This role requires a strong background in data architecture, data engineering, and cloud-based data platforms.The ideal candidate will have experience with data warehousing concepts, ETL processes, and data integration tools.Key...

  • Leading Senior Data Engineer

    1 week ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Big Data EngineerAbout the Role:We are seeking a seasoned Senior Big Data Engineer to lead our data engineering teams and drive innovation in data-driven solutions. Key Responsibilities:Lead distributed teams across multiple geographies and time zones.Collaborate with architects, product managers, and operations to deliver high-quality...

  • Senior Data Engineering Manager

    5 days ago

    Madurai, Tamil Nadu, India beBeeProject Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Technical Project Manager-Data Engineering JobWe are seeking a highly experienced Technical Project Manager to lead our data engineering initiatives.The ideal candidate will have 13+ years of experience in IT with 6+ years of experience as a Technical Product Manager, Technical Program Manager, or Delivery Lead.Responsibilities include:Owning the end-to-end...

  • Highly Skilled Financial Data Solutions Engineer

    4 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data ArchitectThe company seeks an accomplished Senior Data Architect to play a pivotal role in shaping next-generation financial data architecture.This position will leverage expertise in Snowflake, dbt, and modern data engineering practices to build scalable, trusted, and cost-optimized financial data solutions.Main Responsibilities:Architect and...

  • Strategic Data Solutions Developer

    6 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineer RoleOur organization seeks a seasoned data engineer to play a pivotal role in designing, deploying, and maintaining our data platforms.Key ResponsibilitiesConduct thorough analyses of existing data collection systems to recommend enhancements that boost system efficiency and performance.Supervise junior data engineering teams to ensure...

  • Chief Data Solution Architect

    1 week ago

    Madurai, Tamil Nadu, India beBeeDataGovernance Full time ₹ 2,50,00,000 - ₹ 3,50,00,000

    Job OverviewWe are seeking a skilled Senior Architect to join our team. As a Senior Architect, you will be responsible for designing, architecting, deploying, and maintaining big data-based data governance solutions.Our ideal candidate will have a strong background in data governance and experience working with data catalog, business glossary, business...

  • Senior AWS Data Solutions Architect

    5 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Dear Candidate,We are looking for a highly skilled Senior AWS Data Engineer to join our data engineering team.The ideal candidate will have deep expertise in building scalable data pipelines using Apache Spark, PySpark, SQL, and Python, along with hands-on experience in the AWS ecosystem.Key Responsibilities:Design, develop, and maintain robust ETL/ELT...