Data Engineer

1 week ago

tamil nadu, India Lakshya Software Technologies Pvt. Ltd. Full time

Snowflake DBT Engineer total years of experience- 7+ years Location- Pune/Mumbai/Chennai/Bangalore Mandatory Skills: Snowflake- 6 years DBT-6 years Python-3 years Airflow:2 years Azure cloud exp is good to have 5+ years of working experience in Snowflake, Databricks, DBT and Python on Azure/GCP/AWS in production environments and hands-on experience in developing moderate to complex ETL/ELT data pipelines Strong in Apache Spark and Delta Lake, strong SQL and Python abilities, experience with data engineering and ETL pipelines Advanced SQL in Snowflake (CTEs, Views, UDFs, Materialized Views) & DBT Partitioning, clustering, and performance tuning in Snowflake Streams, Tasks, and Snowpipe for real-time and incremental data pipelines Cost and query optimization (e.g., using result cache, pruning, compute credits control) DBT-Data Modeling, SQL Mastery,Jinja Templating, Workflow Optimization & Configuration, Data Loading and Cleaning Hands on Python 3+ years of hands-on experience with Cloud Composer (Airflow) developing DAGs 3+ years of hands-on experience with Databricks and the ability to resolve complex SQL query performance issues 4+ years of ETL Python development experience; experience parallelizing pipelines a plus Demonstrated ability to troubleshoot complex query, pipeline, and data quality issues Develop, test, and deploy robust ETL pipelines on Snowflake on MS Azure/AWS/GCP Platform using, but not limited to, Snowflake/dbt/Databricks, Cloud Composer, and Cloud Run to ingest structured/unstructured data from on-prem SQL Server instances into Snowflake Models/Database/Schema Implement data validation checks, error handling, and logging to ensure pipeline reliability Automate deployment workflows using CI/CD pipelines (GitHub Actions, etc.) and infrastructure-as-code (IaC) tools Monitor pipelines via Cloud Logging and Cloud Monitoring, implementing alerting for data latency or quality issues

  • Data & Business Insights Analyst

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Key Responsibilities Designing data models using Power BI Desktop and DAX Data Analysis Expressions Cleaning and transforming data using Power Query Editor Integrating data from multiple sources SQL Excel cloud services APIs Creating interactive dashboards and reports tailored to business needs Implementing visualizations that clearly communicate KPIs and...

  • Data Engineer

    4 days ago

    tamil nadu, India Tata Consultancy Services Full time

    Big Data/Hadoop Experience particularly in ingesting data and implementing Data ingestion pipelines, SQOOP, HADOOP, HDFS, HIVE, IMPALA, Java, Scala, Spark Scala is Mandatory Data Engineer with below responsibilities:Lead Data Engineer to build data pipelines to support implementation of data science and analytics use cases. Candidate needs to be able to...

  • Data Engineer

    4 days ago

    tamil nadu, India Tata Consultancy Services Full time

    Big Data/Hadoop Experience particularly in ingesting data and implementing Data ingestion pipelines, SQOOP, HADOOP, HDFS, HIVE, IMPALA, Java, Scala, Spark Scala is Mandatory Data Engineer with below responsibilities: Lead Data Engineer to build data pipelines to support implementation of data science and analytics use cases. Candidate needs to be able to...

  • Data Engineer

    4 days ago

    tamil nadu, India Tata Communications Full time

    Position OverviewAn experienced Senior Data Engineer with at least 5 years of hands-on experience in data engineering. The ideal candidate will have a solid understanding of big data technologies and be skilled in building scalable data infrastructure, designing ETL pipelines, and leveraging tools like Hadoop, PySpark, Kafka, and Apache NiFi.Key...

  • Data Engineer

    1 week ago

    tamil nadu, India NexionPro Services Full time

    Job Description – Data EngineerJob Title: Data EngineerExperience: 4–10 YearsLocation: ChennaiNotice Period: Immediate to 15 DaysWork Mode: HybridMandatory Skills: Azure, Databricks, Python, PySpark, SQLAdditional Requirement: Minimum 3 months of GenAI experienceRole OverviewAltimetrik is looking for an experienced Data Engineer with strong expertise in...

  • Data Engineer

    2 weeks ago

    tamil nadu, India IntraEdge Full time

    Job Title: Data Engineer Experience: 3 to 7 Years Location: Chennai Work Mode: Onsite / Hybrid (as applicable) Job Description: We are looking for a highly skilled and motivated Data Engineer with 3 to 7 years of experience to join our growing team in Chennai. The ideal candidate will have strong expertise in DBT, Snowflake, CI/CD pipelines , and SQL , with...

  • Data Engineer

    2 hours ago

    tamil nadu, India Meril Full time

    Job Title: Data Engineer – Medical Imaging & Health DataExperience Required: Minimum 3 YearsLocation: ChennaiEmployment Type: Full-timeAbout the RoleWe are seeking a skilled and experienced Data Engineer with a strong background inmedical imaging and healthcare data to join our growing team. The role involves buildingscalable and secure data infrastructure...

  • Data Engineer

    4 days ago

    tamil nadu, India Raretech Full time

    Company DescriptionRareTech is a leading IT Products and Services company catering to the needs of clients in Bahrain and the GCC region. The company focuses on providing tailored solutions, leveraging its expertise in mobile application development, networking, IT consulting, and outsourcing to meet evolving business requirements. RareTech has a...

  • Data Engineer

    2 weeks ago

    tamil nadu, India DataMoo.AI Full time

    Company Description DataMoo AI, a Chennai-based start-up and the AI Unit of Matvik Solutions Pvt Ltd, specializes in developing innovative products in the field of Artificial Intelligence. The company collaborates with highly skilled doctorates and industry experts to deliver cutting-edge solutions in areas such as conversational AI, natural language...

  • Data Engineer

    2 weeks ago

    tamil nadu, India DataMoo.AI Full time

    Company DescriptionDataMoo AI, a Chennai-based start-up and the AI Unit of Matvik Solutions Pvt Ltd, specializes in developing innovative products in the field of Artificial Intelligence. The company collaborates with highly skilled doctorates and industry experts to deliver cutting-edge solutions in areas such as conversational AI, natural language...