Technical Lead – Big Data

4 days ago

Madurai, India Circana Full time

Technical Lead – Big Data


Let’s be unstoppable together


At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversity, equity, and inclusion as we believe in the undeniable strength that diversity brings to our business, employees, clients, and communities (with us you can always bring your full self to work). Join our inclusive, committed team to be a challenger, own outcomes, and stay curious together. Learn more at www.circana.com.


What will you be doing?


As a part of this team, you’ll work alongside the brightest minds. As a Big Data Lead evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders.

Design, develop, and maintain highly scalable data processing applications.


Job Responsibilities


  • Write efficient, reusable and well documented code
  • Deliver big data projects using Spark, Scala , Python, SQL
  • Maintain and tune existing Spark applications to the fullest.
  • Find opportunities for optimizing existing spark applications.
  • Work closely with QA, Operations and various teams to deliver error free software on time.
  • Actively lead / participate daily agile / scrum meetings.
  • Take responsibility for Apache Spark development and implementation.


Requirements


  • Engineering graduates in computer science backgrounds preferred with 8+ years of software development experience with Hadoop framework components(HDFS, Spark, Spark, Scala, PySpark)
  • Excellent at verbal, written and presentation skills
  • Ability to present and defend a solution with technical facts & business proficiency
  • Understanding of data-warehousing and data-modeling techniques
  • Strong data engineering skills
  • Knowledge of Core Java, Linux, SQL, and any scripting language
  • At least 6+ years of experience using Python / Scala, Spark,SQL
  • Knowledge of shell scripting is a plus
  • Knowledge of Core and Advance Java is a plus.
  • Experience in developing and tuning spark applications.
  • Excellent understanding of spark architecture, data frames and tuning spark.
  • Strong knowledge of database concepts, systems architecture, and data structures is a must Process oriented with strong analytical and problem-solving skills.
  • Experience in writing Python standalone applications dealing with PySpark API.


Circana Behaviors


As well as the technical skills, experience and attributes that are required for the role, our shared behaviors sit at the core of our organization. Therefore, we always look for people who can continuously champion these behaviors throughout the business within their day-to-day role:


  • Stay Curious: Being hungry to learn and grow, always asking the big questions
  • Seek Clarity: Embracing complexity to create clarity and inspire action
  • Own the Outcome: Being accountable for decisions and taking ownership of our choices
  • Center on the Client: Relentlessly adding value for our customers
  • Be a Challenger: Never complacent, always striving for continuous improvement
  • Champion Inclusivity: Fostering trust in relationships engaging with empathy, respect and integrity
  • Commit to each other: Contributing to making Circana a great place to work for everyone


Location


This position can be located in the following area(s): Pune


Note –


“An offer of employment may be conditional upon successful completion of a background check in accordance with local legislation and our candidate privacy notice. Your current employer will not be contacted without your permission”.

  • Technical Lead

    2 weeks ago

    Madurai, India Kevell Corp Full time

    Skill -React front end ,nod backend,angularWe are searching for an innovative technical lead to join our company. As the technical lead, you will oversee the companys technical team and all projects they undertake, analyze briefs, write progress reports, identify risks, and develop work schedules. You should be able to work with your team and inspire them to...

  • Lead Consultant – Data

    1 month ago

    madurai, India Fluidata Analytics Full time

    Experience:Minimum 5 years of experience with BI and Data Warehouse and minimum 2 years managing/ leading the team. About Fluidata:Fluidata Analytics is a modern data and analytics consultancy firm. Our team of experts provides end-to-end data engineering and analytics services to clients by using cutting-edge data technology and methodologies.  Job...

  • Data Engineer

    4 weeks ago

    Madurai, Tamil Nadu, India DMAIC Academy & Consultancy Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at DMAIC Academy & Consultancy. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and data processing workflows using Python, PySpark, and Spark.Key Responsibilities:Design and implement data pipelines and data processing...

  • Data Scientist

    4 weeks ago

    Madurai, Tamil Nadu, India DMAIC Academy & Consultancy Full time

    Job Title: Python DeveloperLocation: RemoteWe are seeking a skilled Python Developer to join our team at DMAIC Academy & Consultancy. As a Python Developer, you will be responsible for designing, developing, and maintaining data pipelines and data processing workflows using Python, PySpark, and Spark.Key Responsibilities:Design and develop data pipelines and...

  • Data Architect

    1 month ago

    madurai, India Velotio Technologies Full time

    Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work® and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS,...

  • Technical Lead

    3 weeks ago

    madurai, India HCLTech Full time

    Total Years of Experience: 5 to 8YearsNotice period: Immediate to 30 days Location: MaduraiDatabricks – Pyspark, Python ( Primary) • Unity catalog • ETL • AWS • Design of data solutions on Databricks including delta lake, data warehouse, data marts and other data solutions to support the analytics needs of the organization. • Apply best practices...

  • Technical lead

    3 weeks ago

    Madurai, India HCLTech Full time

    Total Years of Experience: 5 to 8 Years Notice period: Immediate to 30 days Location: Madurai Databricks – Pyspark, Python ( Primary) • Unity catalog • ETL • AWS • Design of data solutions on Databricks including delta lake, data warehouse, data marts and other data solutions to support the analytics needs of the organization. • Apply best...

  • Technical Lead

    2 months ago

    madurai, India HCLTech Full time

    Total Years of Experience: 5 to 8YearsNotice period: Immediate to 30 days Location: MaduraiDatabricks – Pyspark, Python ( Primary) • Unity catalog • ETL • AWS • Design of data solutions on Databricks including delta lake, data warehouse, data marts and other data solutions to support the analytics needs of the organization. • Apply best practices...

  • Technical Lead

    2 months ago

    Madurai, India HCLTech Full time

    Total Years of Experience: 5 to 8YearsNotice period: Immediate to 30 days Location: MaduraiDatabricks – Pyspark, Python ( Primary) • Unity catalog • ETL • AWS • Design of data solutions on Databricks including delta lake, data warehouse, data marts and other data solutions to support the analytics needs of the organization. • Apply best practices...

  • Technical Lead

    2 months ago

    madurai, India HCLTech Full time

    Total Years of Experience: 5 to 8Years Notice period: Immediate to 30 days Location: Madurai Databricks – Pyspark, Python ( Primary) • Unity catalog • ETL • AWS • Design of data solutions on Databricks including delta lake, data warehouse, data marts and other data solutions to support the analytics needs of the organization. • Apply best...

  • Project Lead

    2 months ago

    Madurai, India HCLTech Full time

    1..Net ,Azure Cloud,Angular2..Net/ETL/Azure (Secondary)3..Net/ETL/SQL, Azure (Secondary)4..Net:SQL,Good Communication Secondary: Any one of the UI Angular,React NodeJSMust have at least 6 to 9 years' experience handling .NET MVC, C#, AWS, PostgreSQLProven experience with any AWS services (ECR/EMR/ECS/Batch/Lambda)Hands-on experience with Docker and...

  • Data Scientist

    4 weeks ago

    Madurai, Tamil Nadu, India Kukulkan Manpower Consultancy Full time

    Job DescriptionKukulkan Manpower Consultancy is seeking a highly skilled Web Application Tester to join our team.The ideal candidate will have a strong background in Python Programming, Big Data, and SQL, with experience in Statistical Analysis and Data Visualization.Responsibilities will include:Designing and implementing comprehensive test plans for web...

  • Project Lead

    2 months ago

    Madurai, India HCLTech Full time

    1..Net ,Azure Cloud,Angular2..Net/ETL/Azure (Secondary)3..Net/ETL/SQL, Azure (Secondary)4..Net:SQL,Good Communication Secondary: Any one of the UI Angular,React NodeJSMust have at least 6 to 9 years' experience handling .NET MVC, C#, AWS, PostgreSQLProven experience with any AWS services (ECR/EMR/ECS/Batch/Lambda)Hands-on experience with Docker and...

  • Project Lead

    2 months ago

    Madurai, India HCLTech Full time

    1..Net ,Azure Cloud,Angular 2..Net/ETL/Azure (Secondary) 3..Net/ETL/SQL, Azure (Secondary) 4..Net:SQL,Good Communication Secondary: Any one of the UI Angular,React NodeJS Must have at least 6 to 9 years' experience handling .NET MVC, C#, AWS, PostgreSQL Proven experience with any AWS services (ECR/EMR/ECS/Batch/Lambda) Hands-on experience with Docker and...

  • Project Lead

    2 months ago

    madurai, India HCLTech Full time

    1..Net ,Azure Cloud,Angular2..Net/ETL/Azure (Secondary)3..Net/ETL/SQL, Azure (Secondary)4..Net:SQL,Good Communication Secondary: Any one of the UI Angular,React NodeJSMust have at least 6 to 9 years' experience handling .NET MVC, C#, AWS, PostgreSQLProven experience with any AWS services (ECR/EMR/ECS/Batch/Lambda)Hands-on experience with Docker and...

  • Technical Lead

    2 months ago

    Madurai Palace, India HCLTech Full time

    Total Years of Experience: 5 to 8YearsNotice period: Immediate to 30 days Location: MaduraiDatabricks – Pyspark, Python ( Primary)-Unity catalog-ETL-AWS-Design of data solutions on Databricks including delta lake, data warehouse, data marts and other data solutions to support the analytics needs of the organization.-Apply best practices during design in...

  • Technical Director

    2 weeks ago

    Madurai, Tamil Nadu, India Kevell Corp Full time

    Technical Lead Role at Kevell CorpWe are seeking a skilled technical lead to oversee our technical team and projects. As a technical lead, you will analyze briefs, write progress reports, identify risks, and develop work schedules. You should be able to work with your team and inspire them to achieve their goals.To succeed as a technical lead, you should...

  • Digital Marketing Executive

    5 months ago

    Madurai, India Big A Solutions Full time

    **Responsibilities**: - Developing and monitoring campaign budgets. - Planning and managing our social media platforms. - Preparing accurate reports on our marketing campaign’s overall performance. - Coordinating with advertising and media experts to improve marketing results. - Identifying the latest trends and technologies affecting our industry. -...

  • AWS Data Architect

    4 weeks ago

    Madurai, India HCLTech Full time

    AWS Data ArchitectJob location: Chennai and BangaloreJob description:We are seeking an experienced AWS Principal Data Architect to lead the migration of Hadoop DWH workloads from on-premise to AWS EMR. As an AWS Data Architect, you will be a recognized expert in cloud data engineering, developing solutions designed for effective data processing and...

  • Technical Lead

    2 months ago

    madurai, India HCLTech Full time

    Total years of experience: 5 to 8 Years Notice period: Immediate to 30 days Location: Madurai Active Directory Penetration Testing Red Team Activities which are beyond basics such as { OSINT (Open-Source Intelligence), Information gathering, Phishing Simulations etc}. Firewall Penetration Testing (apart from Firewall Configuration review) Azure / AWS Cloud...