Technical Lead – Big Data

4 weeks ago


Pune, India Circana Full time
Technical Lead – Big Data
Let’s be unstoppable together
At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversity, equity, and inclusion as we believe in the undeniable strength that diversity brings to our business, employees, clients, and communities (with us you can always bring your full self to work). Join our inclusive, committed team to be a challenger, own outcomes, and stay curious together. Learn more at .
What will you be doing?
As a part of this team, you’ll work alongside the brightest minds. As a Big Data Lead evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders.
Design, develop, and maintain highly scalable data processing applications.
Job Responsibilities
Write efficient, reusable and well documented code
Deliver big data projects using Spark, Scala , Python, SQL
Maintain and tune existing Spark applications to the fullest.
Find opportunities for optimizing existing spark applications.
Work closely with QA, Operations and various teams to deliver error free software on time.
Actively lead / participate daily agile / scrum meetings.
Take responsibility for Apache Spark development and implementation.
Requirements
Engineering graduates in computer science backgrounds preferred with 8+ years of software development experience with Hadoop framework components(HDFS, Spark, Spark, Scala, PySpark)
Excellent at verbal, written and presentation skills
Ability to present and defend a solution with technical facts & business proficiency
Understanding of data-warehousing and data-modeling techniques
Strong data engineering skills
Knowledge of Core Java, Linux, SQL, and any scripting language
At least 6+ years of experience using Python / Scala, Spark,SQL
Knowledge of shell scripting is a plus
Knowledge of Core and Advance Java is a plus.
Experience in developing and tuning spark applications.
Excellent understanding of spark architecture, data frames and tuning spark.
Strong knowledge of database concepts, systems architecture, and data structures is a must Process oriented with strong analytical and problem-solving skills.
Experience in writing Python standalone applications dealing with PySpark API.
Circana Behaviors
As well as the technical skills, experience and attributes that are required for the role, our shared behaviors sit at the core of our organization. Therefore, we always look for people who can continuously champion these behaviors throughout the business within their day-to-day role:
Stay Curious: Being hungry to learn and grow, always asking the big questions
Seek Clarity: Embracing complexity to create clarity and inspire action
Own the Outcome: Being accountable for decisions and taking ownership of our choices
Center on the Client: Relentlessly adding value for our customers
Be a Challenger: Never complacent, always striving for continuous improvement
Champion Inclusivity: Fostering trust in relationships engaging with empathy, respect and integrity
Commit to each other: Contributing to making Circana a great place to work for everyone
Location
This position can be located in the following area(s): Pune
Note –
“An offer of employment may be conditional upon successful completion of a background check in accordance with local legislation and our candidate privacy notice . Your current employer will not be contacted without your permission”.

  • pune, India Circana Full time

    Technical Lead – Big Data Let’s be unstoppable together! At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversity, equity, and...

  • Technical lead

    1 month ago


    Pune, India Circana Full time

    Technical Lead – Big Data Let’s be unstoppable together! At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversity, equity,...


  • Pune, India Circana Full time

    Technical Lead – Big DataLet’s be unstoppable together!At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversity, equity, and...


  • Pune, India Circana Full time

    Technical Lead – Big DataLet’s be unstoppable together!At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversity, equity, and...


  • Pune, India Circana Full time

    Technical Lead – Big Data Let’s be unstoppable together! At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversity, equity, and...


  • Pune, Maharashtra, India NTT DATA Full time

    Company OverviewNTT DATA is a global technology services company that helps clients innovate, optimize and transform for long term success. We have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our Commitment to YouEstimated Salary: ₹2,200,000 - ₹3,500,000 per annum (dependent on...

  • Big Data Engineer

    2 months ago


    Pune, India SGS Technical Services Pvt. Ltd Full time

    Position : Big Data EngineerExperience : 3-5 yearsLocation : PuneNotice Period : Immediate joiner preferredKey Responsibilities :- Design, develop, and maintain scalable data processing systems using Hadoop and PySpark.- Implement data pipelines to process large datasets efficiently.- Work with data warehousing solutions to ensure proper storage and...

  • Big Data Engineer

    2 weeks ago


    Pune, India SGS Technical Services Pvt. Ltd Full time

    Position : Big Data EngineerExperience : 3-5 yearsLocation : PuneNotice Period : Immediate joiner preferredKey Responsibilities : - Design, develop, and maintain scalable data processing systems using Hadoop and PySpark. - Implement data pipelines to process large datasets efficiently. - Work with data warehousing solutions to ensure proper storage...

  • Big data developer

    7 days ago


    Pune, India Recro Full time

    To be successful in this role, you should possess• Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.• Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.• Design and...

  • SQL Technical Lead

    2 weeks ago


    Pune, India Response Informatics Limited Full time

    Role : SQL Technical Lead.Location : Pune (Onsite). Worked in Big data/ Hadoop ecosystem. Exp range 6 to 8 yearsTech lead with some management exp - 8-10 experience Strong relevant experience of 8 years in pySpark, Bigdata with ADLS Gen 2.Key Responsibilities : - Lead and mentor a team of SQL developers. - Provide technical guidance and solutions to complex...

  • Big Data Developer

    1 week ago


    Pune, India Recro Full time

    To be successful in this role, you should possess• Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.• Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.• Design and...

  • Big Data Developer

    7 days ago


    Pune, India Recro Full time

    To be successful in this role, you should possess• Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.• Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.• Design and...

  • Big Data Developer

    1 week ago


    Pune, India Recro Full time

    To be successful in this role, you should possess • Collaborate closely with Product Management and Engineering leadership to devise and build the right solution. • Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale. • Design and...

  • Intern - Big Data

    6 months ago


    Pune, Maharashtra, India Seagate Technology Full time

    **About our group**: We are a proactive, highly solutions oriented and collaborative team that works with all the various business groups across the organization. Our purpose is capturing massive amounts of data is to transform this vital information into concrete and valuable insights that will allow Seagate to make better and more strategic business...

  • Intern - Big Data

    6 months ago


    Pune, Maharashtra, India Seagate Technology Full time

    **About our group**: We are a proactive, highly solutions oriented and collaborative team that works with all the various business groups across the organization. Our purpose is capturing massive amounts of data is to transform this vital information into concrete and valuable insights that will allow Seagate to make better and more strategic business...

  • Big Data Architecture

    6 months ago


    Pune, India Nexgensis Technologies PVT LTD Full time

    Roles & Responsibilities: Architect, design, and develop large scale, end-to-end data platforms across Big Data, Data Science, Cloud Computing, Data Analytics, and Data Visualization domains. Engage with stakeholders and other technical leads to translate complex requirements into actionable platform architectures. Oversee the implementation of designed...

  • Big Data Lead

    6 months ago


    Pune, India Hexaware Technologies Full time

    Description : Expert in Snowflake implementations (with 7 to 10 years in Cloud/Data industry)  7+ years' experience in cloud data engineering experience   5+ years strong experience in SQL, stored procedures, ELT in Snowflake Environment.   2+ years of experience in Python development for Data engineering.  Experience cloud/on-prem devops...

  • Big Data

    6 months ago


    Pune, India Virtusa Full time

    **Duties & Responsibilities**: - Requirement Analysis, Design, Develop and Deploy project/tasks while adhering to existing SDLC standards. - Provide project/task effort estimates. - Provide regular project progress & Issue report. - Partner with multiple teams to deliver projects. - Scope and deliver various Big Data solutions. - Ability to design solutions...


  • Pune, Maharashtra, India Circana Full time

    At Circana, we are on a mission to empower our team members with the skills and knowledge they need to excel in their roles. As a Big Data Engineer Lead, you will be part of a dynamic team that is passionate about delivering high-quality solutions.We are seeking an experienced technical lead who can evaluate domain, financial, and technical feasibility of...

  • Big data

    1 month ago


    Pune, India NR Consulting - India Full time

    Job Title: Big DataExperience: 4-9 yearsLocation: PuneSkills: ETL Testing, SQL query, Java, Selenium, API Testing, Big Data(Junit/Test NG/Selenium)