Senior Data Engineer

3 days ago

Anand, Gujarat, India Tredence Inc. Full time

About the Company

Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia.

We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.

Tredence is an equal opportunity employer. We celebrate and support diversity and are committed to creating an inclusive environment for all employees.

Visit our website for more details: https://www.tredence.com/

Responsibilities

  • Developing Modern Data Warehouse solutions using Snowflake and ADF.
  • Ability to provide solutions that are forward-thinking in data engineering and analytics space.
  • Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
  • Triage issues to find gaps in existing pipelines and fix the issues.
  • Work with business to understand the need in the reporting layer and develop a data model to fulfill reporting needs.
  • Help joiner team members to resolve issues and technical challenges.
  • Drive technical discussions with client architect and team members.
  • Orchestrate the data pipelines in the scheduler via Airflow.

Qualifications

  • Bachelor's and/or master's degree in computer science or equivalent experience.
  • Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.

Required Skills

  • Expertise in Snowflake security, Snowflake SQL and designing/implementing other Snowflake objects.
  • Hands-on experience with Snowflake utilities, SnowSQL, Snowpipe, Snowsight and Snowflake connectors.
  • Deep understanding of Star and Snowflake dimensional modeling.
  • Strong knowledge of Data Management principles.
  • Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture.
  • Should have hands-on experience in SQL and Spark (PySpark).
  • Experience in building ETL / data warehouse transformation processes.
  • Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J).
  • Experience working with structured and unstructured data including imaging & geospatial data.
  • Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
  • Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning, troubleshooting and Query Optimization.
  • Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
  • Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects.
  • Should have experience working in Agile methodology.
  • Strong verbal and written communication skills.
  • Strong analytical and problem-solving skills with a high attention to detail.

Preferred Skills

  • Snowflake/Azure Data Factory/ PySpark.

  • Senior Data Engineer

    3 days ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to join our team.Design, develop, and maintain large-scale data pipelines using PySparkCollaborate with cross-functional teams to integrate data into cloud-based data platformsDevelop and implement data processing solutions using Spark SQL, DataFrame, and RDD...

  • Senior Data Engineering Leader

    13 hours ago

    Anand, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a seasoned data engineering professional to lead our team of senior engineers in delivering high-quality features and maintaining Spark applications.The ideal candidate will have extensive experience in software development, focusing on backend and data engineering, with a strong background in Python, JVM, and Shell Scripting.A...

  • Senior data engineer – gcp

    2 weeks ago

    Anand, Gujarat, India Xebia Full time

    ???? We're Hiring: Senior Data Engineer – GCP | Big Data | Databricks???? Locations: Chennai | Bangalore | Hyderabad | Gurugram | Jaipur | Pune | Bhopal???? Shift Timing: 2:00 PM – 10:00 PM IST???? Experience: 8+ Years???? Immediate Joiners Only (0–15 Days Notice)Are you an expert Data Engineer ready to build large-scale data platforms on Google Cloud...

  • Senior Data Engineer

    2 days ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    We are seeking a senior data engineer to lead our serverless data pipeline.Location - Chennai/Bangalore/HyderabadRole - FTEAvailability - ImmediateWe require the candidate to have experience in designing and implementing data ingestion/transformation using AWS services.The ideal candidate will be able to move clients towards an ELT approach, aligning with...

  • Data Engineer

    5 days ago

    Anand, Gujarat, India Insight Global Full time

    100% Remote Data Engineer Required Skills & Experience5+ years of experience as a Data EngineerExpertise in Python, Pyspark and SQLHands-on Python/PySpark coding experienceStrong Big Data experience, GCP preferredTelemetry experienceStreaming experience with analytics and data processingBusiness analytics experience and working directly with business...

  • Senior Data Engineer

    5 days ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Data Engineer - ETL ExpertWe are seeking a skilled data engineering professional who is comfortable working on complex data engineering tasks with a focus on developing and maintaining efficient ETL pipelines using FiveTran, DBT Cloud, and custom frameworks.Data Engineering Responsibilities:Design and implement scalable ETL pipelines using...

  • Senior Data Architect

    4 days ago

    Anand, Gujarat, India beBeeDataEngineering Full time US$ 1,20,000 - US$ 2,00,000

    Job DescriptionAs a Senior Data Engineer, you will be responsible for designing and implementing scalable data architectures, building real-time and batch processing workflows, and optimizing data solutions on cloud platforms.The ideal candidate will have 4+ years of experience in data engineering, with expertise in Pyspark, Databricks, SQL, Azure/AWS/GCP,...

  • Data Engineering Team Lead

    2 days ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Senior Data Engineer LeaderWe are seeking an experienced Senior Data Engineer to lead our data engineering team, collaborating with cross-functional groups to design and implement cutting-edge solutions. The ideal candidate will possess strong technical expertise in designing, developing, and optimizing ETL/ELT data pipelines using Apache Spark, AWS Glue,...

  • Senior Cloud Data Architect

    4 days ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewThe Senior Data Engineer will play a pivotal role in designing, developing, and optimizing data ingestion, transformation, and governance frameworks for real-time and batch data analytics across our data platform.This role requires a strong background in cloud-native data engineering, primarily on Microsoft Azure, with familiarity with AWS and...

  • Chief Data Engineering Expert

    2 days ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000

    Senior Data Engineer - Informatica IICS DeveloperWe are seeking an experienced Senior Data Engineer to design, develop, and maintain ETL/ELT workflows using Informatica Intelligent Cloud Services (IICS). The ideal candidate will have a strong background in cloud-based data platforms, including Google Cloud Platform (GCP) and Google BigQuery (GBQ).Main...