Senior Data Engineer

1 day ago

tamil nadu, India Tredence Inc. Full time

Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect


Experience: 6-12 years


Location: Bangalore, Chennai, Delhi, Pune, Kolkata


About Tredence:


Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia.

We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data’s full potential.


Primary Roles and Responsibilities:


● Developing Modern Data Warehouse solutions using Databricks and Azure Stack

● Ability to provide solutions that are forward-thinking in data engineering and analytics space

● Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

● Triage issues to find gaps in existing pipelines and fix the issues

● Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs

● Help joiner team members to resolve issues and technical challenges.

● Drive technical discussion with client architect and team members

● Orchestrate the data pipelines in scheduler via Airflow


Skills and Qualifications:


● Bachelor's and/or master’s degree in computer science or equivalent experience.

● Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.

● Deep understanding of Star and Snowflake dimensional modelling.

● Strong knowledge of Data Management principles

● Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

● Should have hands-on experience in SQL, Python and Spark (PySpark)

● Candidate must have experience in AWS/ Azure stack

● Desirable to have ETL with batch and streaming (Kinesis).

● Experience in building ETL / data warehouse transformation processes

● Experience with Apache Kafka for use with streaming data / event-based data

● Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)

● Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

● Experience working with structured and unstructured data including imaging & geospatial data. ● Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

● Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot

● Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

● Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects

● Should have experience working in Agile methodology

● Strong verbal and written communication skills.

● Strong analytical and problem-solving skills with a high attention to detail.


Mandatory Skills: Python/ PySpark / Spark with Azure/ Databricks


Tredence is an equal opportunity employer. We celebrate and support diversity and are committed to creating an inclusive environment for all employees. Visit our website for more details: https://www.tredence.com/


NP: Immediate to 15 Days

  • Senior Data Engineer

    1 day ago

    tamil nadu, India Tredence Inc. Full time

    Role: Senior ETL developerExperience: 5+ yearsLocation: Chennai, Pune, KolkakaAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and...

  • Senior Data Engineer

    1 day ago

    tamil nadu, India InfoBeans Full time

    About the Job:Job Title: Senior Data EngineerSkills : Azure Data Factory (Azure Data Factory, Fabric Data Factory, SQL, Matillion, PythonExperience Required : 7+ YearsLocation: Chennai, Bangalore, Hyderabad, IndoreNotice Period: Serving Notice - 45 daysJob Description:Experienced Data Professional with strong SQL skills, focusing on data integration,...

  • Senior GCP Data Engineer

    1 day ago

    tamil nadu, India Getronics Full time

    Greeting from Getronics!We have multiple opportunities for Senior GCP Data Engineers for our automotive client in Chennai Location.Position Description:Data Analytics team is seeking a GCP Data Engineer to create, deliver, and support custom data products, as well as enhance/expand team capabilities. They will work on analysing and manipulating large...

  • Senior Data Engineer

    1 day ago

    tamil nadu, India Viasat Full time

    About usOne team. Global challenges. Infinite opportunities. At Viasat, we’re on a mission to deliver connections with the capacity to change the world. For more than 35 years, Viasat has helped shape how consumers, businesses, governments and militaries around the globe communicate. We’re looking for people who think big, act fearlessly, and create an...

  • Senior Data Engineer

    2 days ago

    Tamil Nadu, India NovintiX Full time

    NovintiX is seeking a highly skilled and experienced Data Engineers (x4) to join our growing data team focused on delivering impactful solutions in the healthcare and medical technology space. If you’re passionate about building scalable pipelines, driving analytics, and working with healthcare data standards—this role is for you!

  • Senior Data Engineer

    21 hours ago

    Tamil Nadu, India NovintiX Full time

    NovintiX is seeking a highly skilled and experienced Data Engineers (x4) to join our growing data team focused on delivering impactful solutions in the healthcare and medical technology space. If you’re passionate about building scalable pipelines, driving analytics, and working with healthcare data standards—this role is for you!

  • Senior Data Engineer

    1 day ago

    tamil nadu, India CYGNVS Full time

    Data Engineer Location: Chennai (Hybrid) We’re looking for Data Engineers on our Analytics Engineering team - you’ll collaborate with teams across the globe to build pipelines and systems to deliver data insights critical to our customers and internal teams. You’ll be part of a cross functional team that’s responsible for the full product development...

  • Senior Data Engineer

    1 day ago

    tamil nadu, India NovintiX Full time

    NovintiX is seeking a highly skilled and experienced Data Engineers (x4) to join our growing data team focused on delivering impactful solutions in the healthcare and medical technology space. If you’re passionate about building scalable pipelines, driving analytics, and working with healthcare data standards—this role is for you!🔍 𝗞𝗲𝘆

  • Senior Data Engineer

    2 days ago

    Tamil Nadu, India NovintiX Full time

    NovintiX is seeking a highly skilled and experienced Data Engineers (x4) to join our growing data team focused on delivering impactful solutions in the healthcare and medical technology space. If you’re passionate about building scalable pipelines, driving analytics, and working with healthcare data standards—this role is for you!🔍 𝗞𝗲𝘆

  • Senior Data Engineer

    24 hours ago

    tamil nadu, India Tata Consultancy Services Full time

    Greetings from TCS Human Resources Team!!!Skill: Snowflake Data Engineer Experience: 6 to 9 YearsLocation: ChennaiRole : Sr. Snowflake Data EngineerRequired Technical Skill Set :Snowflake, dbt, FiveTran, Snowpipe, AWS services: Managed Airflow (MWAA), S3, Lambda. Github – CI/CDMust-Have5+ years of experience of analyzing, integrating, modelling, and...