Data Engineer

2 weeks ago

tamil nadu, India Lakshya Software Technologies Pvt. Ltd. Full time

Snowflake DBT Engineer total years of experience- 7+ yearsLocation- Pune/Mumbai/Chennai/BangaloreMandatory Skills:Snowflake- 6 yearsDBT-6 yearsPython-3 yearsAirflow:2 yearsAzure cloud exp is good to have5+ years of working experience in Snowflake, Databricks, DBT and Python on Azure/GCP/AWS in production environments and hands-on experience in developing moderate to complex ETL/ELT data pipelinesStrong in Apache Spark and Delta Lake, strong SQL and Python abilities, experience with data engineering and ETL pipelinesAdvanced SQL in Snowflake (CTEs, Views, UDFs, Materialized Views) & DBTPartitioning, clustering, and performance tuning in SnowflakeStreams, Tasks, and Snowpipe for real-time and incremental data pipelinesCost and query optimization (e.g., using result cache, pruning, compute credits control)DBT-Data Modeling, SQL Mastery,Jinja Templating, Workflow Optimization & Configuration, Data Loading and CleaningHands on Python3+ years of hands-on experience with Cloud Composer (Airflow) developing DAGs3+ years of hands-on experience with Databricks and the ability to resolve complex SQL query performance issues4+ years of ETL Python development experience; experience parallelizing pipelines a plusDemonstrated ability to troubleshoot complex query, pipeline, and data quality issuesDevelop, test, and deploy robust ETL pipelines on Snowflake on MS Azure/AWS/GCP Platform using, but not limited to, Snowflake/dbt/Databricks, Cloud Composer, and Cloud Run to ingest structured/unstructured data from on-prem SQL Server instances into Snowflake Models/Database/SchemaImplement data validation checks, error handling, and logging to ensure pipeline reliabilityAutomate deployment workflows using CI/CD pipelines (GitHub Actions, etc.) and infrastructure-as-code (IaC) toolsMonitor pipelines via Cloud Logging and Cloud Monitoring, implementing alerting for data latency or quality issues

  • Data & Business Insights Analyst

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Key Responsibilities Designing data models using Power BI Desktop and DAX Data Analysis Expressions Cleaning and transforming data using Power Query Editor Integrating data from multiple sources SQL Excel cloud services APIs Creating interactive dashboards and reports tailored to business needs Implementing visualizations that clearly communicate KPIs and...

  • Data Engineer

    4 days ago

    tamil nadu, India Tata Consultancy Services Full time

    Big Data/Hadoop Experience particularly in ingesting data and implementing Data ingestion pipelines, SQOOP, HADOOP, HDFS, HIVE, IMPALA, Java, Scala, Spark Scala is Mandatory Data Engineer with below responsibilities:Lead Data Engineer to build data pipelines to support implementation of data science and analytics use cases. Candidate needs to be able to...

  • Data Engineer

    4 days ago

    tamil nadu, India Tata Consultancy Services Full time

    Big Data/Hadoop Experience particularly in ingesting data and implementing Data ingestion pipelines, SQOOP, HADOOP, HDFS, HIVE, IMPALA, Java, Scala, Spark Scala is Mandatory Data Engineer with below responsibilities: Lead Data Engineer to build data pipelines to support implementation of data science and analytics use cases. Candidate needs to be able to...

  • Data Engineer

    4 days ago

    tamil nadu, India Tata Communications Full time

    Position OverviewAn experienced Senior Data Engineer with at least 5 years of hands-on experience in data engineering. The ideal candidate will have a solid understanding of big data technologies and be skilled in building scalable data infrastructure, designing ETL pipelines, and leveraging tools like Hadoop, PySpark, Kafka, and Apache NiFi.Key...

  • Data Engineer

    1 week ago

    tamil nadu, India NexionPro Services Full time

    Job Description – Data EngineerJob Title: Data EngineerExperience: 4–10 YearsLocation: ChennaiNotice Period: Immediate to 15 DaysWork Mode: HybridMandatory Skills: Azure, Databricks, Python, PySpark, SQLAdditional Requirement: Minimum 3 months of GenAI experienceRole OverviewAltimetrik is looking for an experienced Data Engineer with strong expertise in...

  • Data Engineer

    2 weeks ago

    tamil nadu, India IntraEdge Full time

    Job Title: Data Engineer Experience: 3 to 7 Years Location: Chennai Work Mode: Onsite / Hybrid (as applicable) Job Description: We are looking for a highly skilled and motivated Data Engineer with 3 to 7 years of experience to join our growing team in Chennai. The ideal candidate will have strong expertise in DBT, Snowflake, CI/CD pipelines , and SQL , with...

  • Data Engineer

    4 days ago

    tamil nadu, India Raretech Full time

    Company DescriptionRareTech is a leading IT Products and Services company catering to the needs of clients in Bahrain and the GCC region. The company focuses on providing tailored solutions, leveraging its expertise in mobile application development, networking, IT consulting, and outsourcing to meet evolving business requirements. RareTech has a...

  • Data Engineer

    2 weeks ago

    tamil nadu, India DataMoo.AI Full time

    Company Description DataMoo AI, a Chennai-based start-up and the AI Unit of Matvik Solutions Pvt Ltd, specializes in developing innovative products in the field of Artificial Intelligence. The company collaborates with highly skilled doctorates and industry experts to deliver cutting-edge solutions in areas such as conversational AI, natural language...

  • Data Engineer

    2 weeks ago

    tamil nadu, India DataMoo.AI Full time

    Company DescriptionDataMoo AI, a Chennai-based start-up and the AI Unit of Matvik Solutions Pvt Ltd, specializes in developing innovative products in the field of Artificial Intelligence. The company collaborates with highly skilled doctorates and industry experts to deliver cutting-edge solutions in areas such as conversational AI, natural language...

  • GCP Data Engineer

    1 week ago

    tamil nadu, India Intellistaff Services Pvt. Ltd Full time

    Job description: Data Engineer with Python and GCP Experience Level: 5 to 9 Years Loc: Chennai Must Have Skillset SQL (4+ Years) Python or PySpark (4+ Years) GCP services (3+ Years) BigQuery Dataflow or Dataproc Pub/Sub Scheduled Query Cloud Functions Monitoring Tools Dashboard Apache Kafka Terraform scripting (2+ Year) Airflow/Astronomer/Cloud Composer (2+...