Big Data Lead

1 month ago


india Tavant Full time

Big Data Lead

Full Time

Job Code: TI-73141 | Tavant Technologies India Private Limited 

India

10 positions

Required Experience

5 - 15 Years

Skills

ETL pipelines,

Apache Spark,

Airflow

+ 3 more

Job Description

Working in onsite Offshore model, should be able to lead and guide a small team of developers.

Ability to mentor and provide direction in architecture and design to onsite/offshore developers.

Define technical requirements and implementation details for the underlying data warehouse and data marts

Roles & Responsibilities


Proficient in designing and developing complex ETL pipelines, leveraging Apache Spark, Airflow, MPP Databases such as Snowflake and KafkaProficiency in Python, SQL and SparkWorking experience in AWS Services (S3, EC2, etc.), Git, Docker

Eligibility

Bachelor’s or master’s degree in Computer Science, Information Systems or related field
Min 8+ years of experience in IT and at least 5+ in relevant technologies.

About Company

With 21+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Consumer Lending, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and Asia-Pacific.Powered by Artificial Intelligence and Machine Learning algorithms, we help our customers improve their operational efficiency, productivity, speed, and accuracy. Our suite of products and solutions are routinely rated high by the industry.Ours is a challenging workplace where teams are diverse, competitive, and continually searching for tomorrow's technology and brilliant minds to create it. And we don’t focus just on what we do – we also care how we do it. So, bring your talent and ambition to make a difference. We’ll create a world of opportunities for you.
  • Big Data Architect

    3 weeks ago


    India Bloom Consulting Services Full time

    NA Experience **12 - 16 years** Offered Salary Notice Period **Not Disclosed** **Role: Big Data Architect** **Location: Bangalore** **Skills required**: Total 12 to 16 years of experience in BI, analytics, visualization, **data** integration, designing and developing **data **warehouses (ETL, **data**bases, front-end tools). 9+ years of...

  • Big Data Architect

    3 weeks ago


    India Bloom Consulting Services Full time

    Not Disclosed Experience **12 - 16 Years** Offered Salary **Lakh** Notice Period **Not Disclosed** **Role: Big Data Architect** **Location: Bangalore** **Skills required**: Total 12 to 16 years of experience in BI, analytics, visualization, **data** integration, designing and developing **data **warehouses (ETL, **data**bases, front-end...

  • Big Data Engineer

    4 weeks ago


    India TekJobs Full time

    This role is for a Data Engineering Lead to work on the Vanguard Big Data Platform. The team is responsible for the maintenance and development of leading Big Data initiatives and use cases providing business value.Job Background/context:The technology team is responsible for building and maintaining a multitude of applications including:Real-time...

  • Big Data Engineer

    4 weeks ago


    india TekJobs Full time

    This role is for a Data Engineering Lead to work on the Vanguard Big Data Platform. The team is responsible for the maintenance and development of leading Big Data initiatives and use cases providing business value. Job Background/context: The technology team is responsible for building and maintaining a multitude of applications including: Real-time...

  • Big Data Analyst

    1 month ago


    india Royal Cyber ​​Inc. Full time

    1) 5+ years of experience managing and deploying CDP or HDP clusters.2) Experience configuring and setup of big data environments.3) Experience with Kerberos security and LDAP setup.4) Experience in setting up monitoring and alerting pipelines for big data clusters.

  • PySpark Tech Lead

    4 weeks ago


    Anywhere in India/Multiple Locations, IN TD Newton & Associates Full time

    Technical Skills :- Extensive experience working on software engineering projects and SDLC- Have worked on various development project as developer and/or lead developer.- Capability to understand and comprehend the solution and create a development framework where all the developers will be contributing.- Should be able to create a Test driven development...

  • PySpark Tech Lead

    1 month ago


    Anywhere in India,Multiple Locations TD Newton & Associates Full time

    Technical Skills :- Extensive experience working on software engineering projects and SDLC- Have worked on various development project as developer and/or lead developer.- Capability to understand and comprehend the solution and create a development framework where all the developers will be contributing.- Should be able to create a Test driven development...


  • india Encora Inc. Full time

    4+ years of developing software using object-oriented or functional language experience4+ years of SQL2-3 + years working with open source Big Data technology stacks (Apache Nifi, Spark, Kafka, HBase, Hadoop/HDFS, Hive, Drill, Pig, etc.) or commercial open source Big Data technology stacks (Hortonworks, Cloudera, etc.)2+ years of distributed version control...


  • Anywhere in India/Multiple Locations, IN Grownex HR Solution Full time

    Role : Lead Big Data EngineerWork Mode : Remote(5 Days working)The Opportunity - Development team is establishing a new offshore product development team for its partner , that is building next-generation Big Data, Cloud-Based Business Operation Support technology for utilities, retail energy suppliers and Community Choice Aggregators (CCA). The candidate...


  • Anywhere in India,Multiple Locations Grownex HR Solution Full time

    Role : Lead Big Data Engineer Work Mode : Remote(5 Days working) The Opportunity - Development team is establishing a new offshore product development team for its partner , that is building next-generation Big Data, Cloud-Based Business Operation Support technology for utilities, retail energy suppliers and Community Choice Aggregators (CCA). The...

  • Big Data Engineer

    3 days ago


    india NeoStats Full time

    Job Description About Neostats Analytics: NeoStats is a new-age, Data & Analytics firm offering contemporary solutions and infinite possibilities. Our mission is to create lasting competitive advantage for our clients by transforming them into world-class, data-driven organizations. Established in 2022 to provide End to End Data & Analytics Services, we...

  • Data Engineering Lead

    2 weeks ago


    Anywhere in India/Multiple Locations VAST Consulting Full time

    Job Description : - Should have 8+ years of working experience.- Bachelor's or Master's degree in Computer Science, Engineering, or related field.- Demonstrated leadership experience leading cross-functional teams in the design and implementation of complex data solutions.- Experience in a data engineering role with strong understanding of graph...

  • Big Data Architect

    3 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN ARR Recruitment Solutions Full time

    About the Role :- We are seeking a highly experienced Big Data Architect to join our team and lead the design, development, and implementation of our big data solutions.- This role is ideal for a candidate with a deep understanding of big data technologies and a proven track record of delivering scalable and robust big data architectures.Responsibilities :-...

  • Big Data Architect

    3 weeks ago


    Bangalore,Anywhere in India,Multiple Locations ARR Recruitment Solutions Full time

    About the Role :- We are seeking a highly experienced Big Data Architect to join our team and lead the design, development, and implementation of our big data solutions.- This role is ideal for a candidate with a deep understanding of big data technologies and a proven track record of delivering scalable and robust big data architectures.Responsibilities :-...

  • Sr. SRE

    1 day ago


    india kadambi Consulting Full time

    Sr. Systems Reliability Engineer The Role Plan, manage, and oversee all aspects of a Production Environment for Big Data Platforms. Define strategies for Application Performance Monitoring, Optimization in Prod environment Respond to Incidents and improvise platform based on feedback and measure the reduction of incidents over time. Ensures that batch...


  • india Digihelic Solutions Pvt. Ltd. Full time

    Job Summary :We are seeking a highly skilled and motivated Product Solution Architect with extensive expertise in designing and implementing cutting-edge big-data solutions on the Amazon Web Services (AWS) platform.As a key member of our dynamic team, you will play a pivotal role in driving the success of our data-driven initiatives, leveraging AWS services...

  • Data Engineer

    2 days ago


    india Evnek Technologies Pvt Ltd Full time

    Job Description This is a remote position. Role: Data Engineer  Experience: 2+Years Notice period: Immediate Location: Anywhere from India Job Type: Full Time Responsibilities: Designing & building data architectures including the design & set-up of scalable (big) data lakes (full cloud or hybrid cloud), scheduled transformations &...

  • GCP Data Architect

    1 month ago


    india Huquo Full time

    Role : GCP Data Architect Description : As a GCP Data Architect, you will be responsible for architecting enterprise data solutions for migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to...

  • Big Data Developer

    3 weeks ago


    india RiskInsight Consulting Pvt Ltd Full time

    We are seeking a skilled Data Engineer with 4-8 years of experience, proficient in Big Data technologies and data processing frameworks. The ideal candidate will have strong expertise in Hadoop ecosystem components such as HDFS, HiveQL, and experience in developing and optimizing data processing workflows using PySpark. Proficiency in SQL for data...

  • AWS Big Data Engineer

    1 month ago


    india Bosch Full time

    Job Description Technical skills ETL development experience with overall 4 to 7 years in AWS , Big data engineering related application Minimum 2 end to end ETL project implementation Proficient in PySpark, Python4. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks5. Expert in AWS to develop, deploy and maintain ETL...