Senior Data Engineer

4 weeks ago

Anand, Gujarat, India Tredence Inc. Full time

About the Company

Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia.

We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.

Tredence is an equal opportunity employer. We celebrate and support diversity and are committed to creating an inclusive environment for all employees.

Visit our website for more details: https://www.tredence.com/

Responsibilities

  • Developing Modern Data Warehouse solutions using Snowflake and ADF.
  • Ability to provide solutions that are forward-thinking in data engineering and analytics space.
  • Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
  • Triage issues to find gaps in existing pipelines and fix the issues.
  • Work with business to understand the need in the reporting layer and develop a data model to fulfill reporting needs.
  • Help joiner team members to resolve issues and technical challenges.
  • Drive technical discussions with client architect and team members.
  • Orchestrate the data pipelines in the scheduler via Airflow.

Qualifications

  • Bachelor's and/or master's degree in computer science or equivalent experience.
  • Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.

Required Skills

  • Expertise in Snowflake security, Snowflake SQL and designing/implementing other Snowflake objects.
  • Hands-on experience with Snowflake utilities, SnowSQL, Snowpipe, Snowsight and Snowflake connectors.
  • Deep understanding of Star and Snowflake dimensional modeling.
  • Strong knowledge of Data Management principles.
  • Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture.
  • Should have hands-on experience in SQL and Spark (PySpark).
  • Experience in building ETL / data warehouse transformation processes.
  • Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J).
  • Experience working with structured and unstructured data including imaging & geospatial data.
  • Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
  • Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning, troubleshooting and Query Optimization.
  • Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
  • Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects.
  • Should have experience working in Agile methodology.
  • Strong verbal and written communication skills.
  • Strong analytical and problem-solving skills with a high attention to detail.

Preferred Skills

  • Snowflake/Azure Data Factory/ PySpark.

  • Senior Data Engineer

    3 weeks ago

    Anand, Gujarat, India JRD Systems Full time

    We are seeking a Senior Data Engineer with deep expertise in AWS Cloud Development. This role is critical to both the development of new data products and the modernization of existing platforms.The ideal candidate is a seasoned data engineer with hands-on experience designing, building, and optimizing large-scale data pipelines and architectures in both...

  • Data Engineer

    4 weeks ago

    Anand, Gujarat, India Insight Global Full time

    100% Remote Data Engineer Required Skills & Experience5+ years of experience as a Data EngineerExpertise in Python, Pyspark and SQLHands-on Python/PySpark coding experienceStrong Big Data experience, GCP preferredTelemetry experienceStreaming experience with analytics and data processingBusiness analytics experience and working directly with business...

  • Senior Engineer

    4 weeks ago

    Anand, Gujarat, India Next Pathway Full time

    Nextpathway | The Automated Cloud Migration CompanyNext Pathway is a technology services company providing clients a pathway from existing to emerging technologies. Our automation technology helps our customers accelerate the migration of complex applications and workloads to the cloud.About the Role:Next Pathway is looking for a highly skilled and...

  • Data Engineer

    4 weeks ago

    Anand, Gujarat, India Aiprus Software Private Limited Full time

    Job Title: Data EngineerRole Overview:We are seeking a skilled and motivated Data Engineer to design, develop, and maintain scalable data pipelines that process and transform large volumes of structured and unstructured data. The ideal candidate will have a strong background in data engineering, cloud technologies, and data architecture, and will collaborate...

  • Lead azure data engineer

    3 weeks ago

    Anand, Gujarat, India RandomTrees Full time

    Immediate #HIRING for a highly motivated and experienced Lead Azure Data Engineer to join our growing team.We're a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologiesIf you're passionate about building robust applications and thrive in a dynamic environment,...

  • Data Engineer

    3 weeks ago

    Anand, Gujarat, India Incept Labs Full time

    Position: Software Engineer (Data)Location: Remote, IndiaAt Incept Labs, we believe the future of education and research lies in humans and AI workingtogether side by side. AI brings the ability to process knowledge at scale, while peoplecontribute imagination, values, and lived experience. When combined, they create a partnershipwhere each strengthens the...

  • Data Engineer

    4 weeks ago

    Anand, Gujarat, India IntraEdge Full time

    Job Title: Data EngineerLocation: [Remote]Experience: [5+ years]Employment Type: Full-timeJob Summary:We are seeking a skilled Data Engineer with hands-on experience in Snowflake, AWS (Lambda, Glue), DBT, and SQL to design, build, and optimize scalable data pipelines. The ideal candidate will be responsible for enabling seamless data integration,...

  • Data Engineer

    3 weeks ago

    Anand, Gujarat, India Alp Consulting Ltd. Full time

    9-12 years of Professional experience designing/building/maintaining highly available data and analytics platform.Hands-on experience with AWS or similar cloud platform building data engineering solutions for analytics and science.Must have experience building complex data pipelines – batch and/or real time event-based processing Strong experience in...

  • azure data engineer

    2 weeks ago

    Anand, Gujarat, India InfoSpeed Services, Inc. Full time

    Roles Open – Akkodis (Remote, 2 Months Project)Azure Data Engineer – 7+ years experienceJunior Azure Data Engineer – 5+ years experienceStatus: Open | Location: Remote

  • Lead Data Platform Engineer

    3 weeks ago

    Anand, Gujarat, India Black Dog Labs Full time

    Position: Lead Data Platform EngineerLocation: Remote (collaboration across time zones), India or LATAM preferredEngagement Type: ContractLanguage: Fluent EnglishExperience: 9+ years in Data Engineering / Backend Engineering / DevOps, including leadership of a team (or end-to-end ownership of large, multi-stakeholder projects)About the RoleWe're looking for...