Senior Databricks Engineer/Technical Lead/Data Architect

2 weeks ago


Delhi NCR, India VIDPRO CONSULTANCY SERVICES Full time

About Tredence :

Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering.

The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale.

Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia.

We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.

Primary Roles and Responsibilities :

- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack

- Ability to provide solutions that are forward-thinking in data engineering and analytics space

- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

- Triage issues to find gaps in existing pipelines and fix the issues

- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs

- Help joiner team members to resolve issues and technical challenges.

- Drive technical discussion with client architect and team members

- Orchestrate the data pipelines in scheduler via Airflow

Skills and Qualifications :

- Bachelor's and/or master's degree in computer science or equivalent experience.

- Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.

- Deep understanding of Star and Snowflake dimensional modelling.

- Strong knowledge of Data Management principles

- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

- Should have hands-on experience in SQL, Python and Spark (PySpark)

- Candidate must have experience in AWS/ Azure stack

- Desirable to have ETL with batch and streaming (Kinesis).

- Experience in building ETL / data warehouse transformation processes

- Experience with Apache Kafka for use with streaming data / event-based data

- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)

- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

- Experience working with structured and unstructured data including imaging & geospatial data.

- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot

- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects

- Should have experience working in Agile methodology

- Strong verbal and written communication skills.

- Strong analytical and problem-solving skills with a high attention to detail.

Mandatory Skills : Python/ PySpark / Spark with Azure/ AWS Databricks

Tredence is an equal opportunity employer.

We celebrate and support diversity and are committed to creating an inclusive environment for all employees.

(ref:hirist.tech)

  • Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Solutions Architect

    4 weeks ago


    Delhi Cantonment, Delhi, Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Solutions Architect

    1 week ago


    new delhi, India Databricks Full time

    As a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible...


  • Delhi, India Marlabs LLC Full time

    Description:Job Title: Technical Lead - Azure DatabricksLocation: Bangalore, IndiaPosition Overview:We are looking for an experienced Technical Lead with 8 to 10 years of hands-on experience working on Azure Databricks and Azure native services. The Technical Lead will play a critical role in managing and driving day-to-day data engineering work and leads...


  • Delhi, India Marlabs LLC Full time

    Description:Job Title: Data Architect - Azure DatabricksLocation: Bangalore, IndiaPosition Overview:We are looking for a Data Architect with 10 to 12 years of experience specializing in Azure Databricks and Azure native services. The ideal candidate will have a proven track record of designing and implementing scalable, high-performance data solutions in...

  • Technical Architect

    3 days ago


    delhi, India Allianz Services Full time

    Designation - Senior Manager / Technical Architect – Data EngineeringExperience Range – 10 to 16 YearsEducation - Bachelor's/master’s degree in computer science, Data Science, or a related fieldLocation – Trivandrum or PuneRoles & responsibility -• Architecting, designing, and implementing scalable data solutions in the data engineering space•...


  • Delhi, India Exusia Full time

    About The PositionDepartment:Sales and Delivery Team - EmpowerIndustry:Information Technology & Services, Computer Software, Management ConsultingLocation:BangaloreExperience Range: 5+ yearsBasic Qualification:Master/Bachelor of Engineering or EquivalentTravel Requirements:Not requiredWebsite:Exusia, a cutting-edge digital transformation consultancy, seeks...

  • Data Engineer

    1 week ago


    delhi, India The Ksquare Group Full time

    RequirementsBachelor's degree in computer science, information technology, or a related field.Prior experience with data lakes and data warehouses, working knowledge with dimensional modeling is must.Demonstrate advanced understanding in data engineering practices, Including ETL/ELT, data integrations, reusable data pipelines,data management methods.Advanced...

  • Data Engineer

    1 month ago


    delhi, India VSquare Systems Pvt. Ltd. Full time

    Job Title: Data Engineer (Azure Databricks)Location: Bangalore / HybridJob Type: Full-timeJob Description:Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive...


  • Delhi, India Tredence Full time

    About TredenceTredence is a global analytics services and solutions company. We are one of the fastest growing private companies in the country for three straight years according to the Inc. 5000 and we continue to set ourselves apart from our competitors by attracting the greatest talent in the data analytics and data science space. Our capabilities range...


  • Delhi, India Marlabs LLC Full time

    Description:Job Title: Senior Data Engineer - Azure Databricks and Azure Native ServicesLocation: Bangalore,IndiaPosition Overview:We are looking for an experienced Senior Data Engineer with 6 to 8 years of hands-on experience working on Azure Databricks and its native services. The Senior Data Engineer will be responsible for designing, building, and...

  • Data Architect

    3 weeks ago


    Delhi, India Tredence Inc. Full time

    Candidates from Bangalore/ Chennai/ Pune/ Gurgaon/ Pune/ Kolkata can applyRoles and Responsibilities:● Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack● Ability to provide solutions that are forward-thinking in data engineering and analytics space● Collaboration with DW/BI leads to understanding new ETL pipeline...


  • delhi, India V3 Staffing Solutions India P Limited Full time

    We have this opening with the global company that is shaping the future of gaming through groundbreaking technology and unparalleled creativity.Senior Data Engineer (AWS): Crafting Efficient Data Pipelines for Cloud PlatformsWe're seeking a seasoned Senior Data Engineer with over 9 years of hands-on experience in crafting and implementing highly efficient...


  • delhi, India Streamline Full time

    Who We AreAt Streamline, we are experts in Enterprise Mobility, Product Engineering, and IT Transformation. We help organizations navigate the constantly evolving landscape of IT. Our sole focus is ensuring that our client’s organization is armed with the strategies, products and solutions that are transformative to their business. Streamline works closely...


  • Delhi, India XPT Software Australia Pty Ltd Full time

    Job DescriptionWe are seeking a talented 10+ years Solution Designer with experience in Databricks to join our team. The ideal candidate will have a strong background in designing and implementing data solutions using Databricks platform. This role requires a deep understanding of data engineering principles, and cloud-based analytics. As a Solution...


  • Delhi, India Tech Mahindra Full time

    Role: Enterprise Data ArchitectLocation: Pune, BangaloreExperience: 15+ yearsNotice period: Immediate to 30 Days MaxInterested candidates can share their profiles to .Position OverviewThe ideal candidate will have a strong background in designing, implementing, and maintaining data solutions on the Azure platform. You will collaborate closely with...

  • Data Architect

    4 weeks ago


    delhi, India Nisum Full time

    Required above 10 years of ETL and Data Engineering experience.• Experience in solutions architect or senior data engineer roles, in the design of data-intensive solutions (streaming, batch, migrations)• Experience in modern data ingestion processes (datalake, datawarehouse, lakehouse)• Experience in data governance models• Experience with relational...


  • Delhi, India Streamline Full time

    Who We AreAt Streamline, we are experts in Enterprise Mobility, Product Engineering, and IT Transformation. We help organizations navigate the constantly evolving landscape of IT. Our sole focus is ensuring that our client’s organization is armed with the strategies, products and solutions that are transformative to their business. Streamline works closely...


  • Delhi, India Streamline Full time

    Who We AreAt Streamline, we are experts in Enterprise Mobility, Product Engineering, and IT Transformation. We help organizations navigate the constantly evolving landscape of IT. Our sole focus is ensuring that our client’s organization is armed with the strategies, products and solutions that are transformative to their business. Streamline works closely...

  • Lead Data Engineer

    3 weeks ago


    delhi, India Recro Full time

    Position: Data Engineer(Lead)Location: WFO-BangaloreExperience Level: 8+ yearsJob Description:Summary:We're seeking a highly skilled and experienced Big Data Architect to join our innovative and dynamic team. You'll play a pivotal role in designing, building, and maintaining our scalable big data infrastructure. The ideal candidate will be a passionate...