Senior Databricks Engineer/Technical Lead/Data Architect

4 weeks ago


Delhi NCR, India VIDPRO CONSULTANCY SERVICES Full time

About Tredence :

Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering.

The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale.

Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia.

We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.

Primary Roles and Responsibilities :

- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack

- Ability to provide solutions that are forward-thinking in data engineering and analytics space

- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

- Triage issues to find gaps in existing pipelines and fix the issues

- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs

- Help joiner team members to resolve issues and technical challenges.

- Drive technical discussion with client architect and team members

- Orchestrate the data pipelines in scheduler via Airflow

Skills and Qualifications :

- Bachelor's and/or master's degree in computer science or equivalent experience.

- Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.

- Deep understanding of Star and Snowflake dimensional modelling.

- Strong knowledge of Data Management principles

- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

- Should have hands-on experience in SQL, Python and Spark (PySpark)

- Candidate must have experience in AWS/ Azure stack

- Desirable to have ETL with batch and streaming (Kinesis).

- Experience in building ETL / data warehouse transformation processes

- Experience with Apache Kafka for use with streaming data / event-based data

- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)

- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

- Experience working with structured and unstructured data including imaging & geospatial data.

- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot

- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects

- Should have experience working in Agile methodology

- Strong verbal and written communication skills.

- Strong analytical and problem-solving skills with a high attention to detail.

Mandatory Skills : Python/ PySpark / Spark with Azure/ AWS Databricks

Tredence is an equal opportunity employer.

We celebrate and support diversity and are committed to creating an inclusive environment for all employees.

(ref:hirist.tech)

  • Delhi NCR, India Huquo Consulting Full time

    Role and Responsibilities Overview: - Develop and implement a comprehensive quality assurance strategy for data engineering projects, ensuring that data quality standards are met throughout the data pipeline. - Collaborate with cross-functional teams to define test plans and strategies for validating data pipelines, ETL processes, and transformations using...

  • Innefu Labs

    4 weeks ago


    Delhi NCR, India Innefu Labs Pvt Ltd Full time

    Job Description :We are seeking a highly skilled and experienced Technical Product Manager to join our dynamic team. As a Technical Product Manager, you will be responsible for leading the development and execution of our product roadmap, with a focus on leveraging Python and related frameworks to deliver innovative solutions to our customers. The ideal...

  • AWS Data Engineer

    4 weeks ago


    Delhi NCR, India A2mantras Full time

    Overview : We are seeking a talented AWS Data Engineer to join our team. The ideal candidate will be responsible for designing, implementing, and maintaining scalable data pipelines and solutions on the AWS cloud platform. This role requires a deep understanding of AWS services, data engineering best practices, and proficiency in programming and scripting...

  • Senior Data Scientist

    4 weeks ago


    Delhi NCR, India MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Exp : 5 to 7 YearsBudget :16 LPA uptoLocation : DelhiJob Title: Senior Data Scientist - Predictive Analysis and Classification Job Description :We're looking for an experienced Senior Data Scientist specializing in Predictive Analysis and Classification to join our team in Delhi. The ideal candidate will leverage advanced analytics and machine learning...


  • Delhi NCR, India IT Full time

    Role- Senior Software EngineerTech Stack- React native, react Js, react hooks, Redux, TypescriptMinimum Experience- 6 YearsJob Description:We are looking for a Sr. React Native developer skilled in building performant mobile apps on both the iOS and Android platforms. You will be responsible for architecting and building these applications, as well as...


  • Delhi NCR/Gurgaon, India Huquo Full time

    RESPONSIBILITIES- Participate as a leader to define, architect and implement the vision for high frequency; low latency trading systems- Lead team of 3-4 senior developers, helping them with design and implementation of their work. And be responsible for quality of the team's outcome.- Understand and translate business requirement into...


  • Delhi NCR, India Strategic Talent partner Full time

    Role : Senior Software EngineerCoreLogic, Inc. is the nation's largest provider of advanced property and ownership information, analytics, and solutions. Our databases covers more than 3,000 counties, representing 97 percent of the nation's real estate transactions. CoreLogic, Inc. is an Irvine, CA- based corporation providing financial, property,...

  • Innefu Labs

    4 weeks ago


    Delhi NCR, India Innefu Labs Pvt Ltd Full time

    Job brief : We are looking for a Solution Architect to join our team and implement systems architecture to help solve our organization's network problems. Solution Architect responsibilities include testing and integrating program software systems to address and solve specific business problems within an organization. Ultimately, you will work with the...


  • Delhi NCR, India Arting Digital Full time

    Role : Sap Hana developer cum architect Exp. : 8 to 12 Years Qualification : B.tech/ B.SC./ BCA Candidate Location : Delhi/NCR Work Location : Delhi/NCR (Remote) Interview location : Remote Skills : -SAP Hana cloud,MM, PP, FICO etc. Role Overview : We are seeking an experienced SAP HANA Developer cum Architect to join our team. The ideal candidate should...


  • Delhi NCR, India sar hr Full time

    Job Description :- 4 - 6 years years of experience in security engineering, security operations, or systems engineering with cyber security engineering responsibilities.- Bachelor's degree in computer science, or related technology degree.- Lead the design, implementation, and ongoing maintenance of our vulnerability management program, encompassing...

  • KiE Square Analytics

    2 weeks ago


    Delhi NCR, India KiE Square Analytics Full time

    Role : Data style="">Job description : KiE Square is a leading AIML Company that provides advanced Data Science/Data Engineering Solutions to its clients and drives their Business Intelligence Transformation.We invite you to join our Core Team of Data Scientists, Data Engineers and AIML Developers who have a sharp analytical bent, have delivered multiple...


  • Delhi NCR, India Arting Digital Full time

    Exp : 8 to 12 YearsQualification : B.tech/ B.SC./ BCACandidate Location : Delhi/NCRWork Location : Delhi/NCR (Remote)Interview location : RemoteSkills : SAP Hana cloud, MM, PP, FICO etc. Role Overview :We are seeking an experienced SAP HANA Developer cum Architect to join our team. The ideal candidate should have a solid background in SAP HANA Cloud, along...


  • Delhi NCR/Noida, India Octro Inc Full time

    A tech savvy gaming company is looking for enterprenual technical intellects to lead one of our technical divisions for deliveries related to Game Development using any of the skills C++, Cocos studio, Unity or Erlang.- Managed a team of resources segregated in different technologies & hierarchy through effective planning, mentoring & coaching.- Setup the...


  • Delhi NCR, India Taxmann Publications Pvt. Ltd. Full time

    Designation:- AI NLP Engineer & Data Analyst/Data Science Develop and deploy chatbots using OpenAI APIs to enhance customer interactions and support processes.- Utilize AI and NLP techniques to extract information and insights from PDF documents.- Collaborate with cross-functional teams to understand business requirements and implement AI solutions.- Conduct...


  • Delhi, India Triumph Ladders Pvt. Ltd. Full time

    Job Title : Frontend Lead and ArchitectExp : 12-16 yearsLocation : DelhiNotice period : 0-30 daysSummary :We are seeking a highly skilled and experienced Frontend Lead and Architect with 12-14 years of expertise to join our dynamic team. In this role, you will be responsible for making key architecture decisions in collaboration with the technical architect,...

  • Engineering Manager

    4 weeks ago


    Delhi NCR, India Karyarth consultancy Full time

    Role : Manager (Engineering)Experience : 10 Year (out of which 3-5 year should be in a team handling Exp)Working Days : 5 Days WorkingLocation : DelhiInterview Type : Virtual & Final round F2F InterviewInterview Rounds : 4 Round of InterviewAbout the client company :It is a specialized Artificial Intelligence solutions company. We provide advanced training...

  • Senior Engineer

    4 weeks ago


    Delhi NCR, India Arting Digital Full time

    Position Title: Senior Engineer- Devops CTC: 20 LPA Experience: 5+ Location: Delhi NCR Working Mode: On-site Primary skills: Kubernetes ,Jenkin CI/CD Pipeline, AWS, , Terraform, Cloud Formation And Red Hat OpenShift Certified. Qualification: Any Engineering/ Computers degree Roles & Responsibilities: - DevOps Strategy: Collaborate with cross-functional...

  • Security Architect

    2 weeks ago


    Delhi NCR, India IRIS Software Full time

    Job Responsibilities :To develop Cyber capabilities in securing IT system changes against threats and further the Group's pursuit of business opportunities. To support business leaders as trusted security advisers when delivering business value at pace whilst remaining within NAB's risk appetite.To consult and help the business, project and technical...


  • Delhi NCR, India sar hr Full time

    Technical Expertise :- Manage multiple teams that designs, develops, troubleshoots and debugs software programs for databases, applications, tools, networks etc.- Apply extensive knowledge of software architecture to manage software development tasks associated with developing, debugging or designing software applications and databases according to provided...


  • Delhi NCR, India W Full time

    About the job :A highly innovative, fast paced, AI startup is looking for leaders with strong background and knowledge in AI/ ML/Computer Vision to be a part of their amazing team, below are the must have's to be a great fit for the role.- They need to have a solid technical background in AI/ML/CV. It's a Technical role for a leader.- Programming...