Big Data Engineer

1 week ago


Chennai, Tamil Nadu, India ADVANSOFT Full time
We are hiring for Data engineer with top most MNC client;

Exp : 5+years

Np :
immediate to 15days

Location :
& Responsibilities :

5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.


  • Experience working with Databases like Oracle, and Netezza and have strong SQL knowledge.
  • Developing scalable streaming solutions based on Hadoop/ Big Data stack such as HDFS, Ozone, Hive/ Impala, Apache Spark, and Kafka.
  • Experience in Data Engineering and implementation. multiple e endtoend DW projects in a Big Data environment.
  • Experience in building data pipelines through Git, Shell, Spark with Java/ Python on Hadoop, or Object storage (S3/CEPH).
  • Strong analytical skills are required for debugging production issues, providing root causes, and implementing mitigation plans.
  • Strong communication skills, both verbal and written and strong relationship, collaboration skills, and organizational skills.
  • Flexible enough to stretch and work in India time to coordinate with the India team.

Experiences :

  • Nice to have development experience in Pythonbased Al/ML workloads on Hadoop.
  • Experience working on Nifi, APLS, and Unix Environments will be an added advantage.
  • Experience of working in Agile teams.
  • Ability to multitask across multiple projects, interface with external and internal resources, and provide technical leadership to junior team members.
  • Ability to be highenergy, detailoriented, proactive, and able to function under pressure in an independent environment along with a high degree of initiative and selfmotivation to drive results.
  • Ability to quickly learn and implement new technologies and perform POC to explore the best solution for the problem statement.
  • Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency.
  • Perform assigned tasks and production incidents independently.
)
  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Hiring Infinity Full time

    Role : Data EngineerWe are looking for a curious Data Engineer to join our extremely fast growing Tech Team About the organization :Founded in 2021, leverages GenAI to enable businesses to effortlessly create and launch ads in seconds.Businesses can manage ads across channels like Facebook, Instagram, Google and WhatsApp in a single platform.Proprietary...

  • Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Hiring Infinity Full time

    Role : Data EngineerWe are looking for a curious Data Engineer to join our extremely fast growing Tech Team About the organization :Founded in 2021, leverages GenAI to enable businesses to effortlessly create and launch ads in seconds.Businesses can manage ads across channels like Facebook, Instagram, Google and WhatsApp in a single platform.Proprietary...

  • Manager (Big Data)

    1 week ago


    Chennai, Tamil Nadu, India Databricks Full time

    CSQ325R53As aBig Data Managerin our Professional Services team you will work with clients on short to medium term customer engagements on theirbig data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to...


  • Chennai, Tamil Nadu, India Databricks Full time

    CSQ125R88As anArchitect (Big Data)in our Professional Services team you will work with clients on short to medium term customer engagements on theirBig Data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...

  • Big Data Architect

    1 week ago


    Chennai, Tamil Nadu, India Databricks Full time

    CSQ125R88As anArchitect (Big Data)in our Professional Services team you will work with clients on short to medium term customer engagements on theirBig Data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...


  • Chennai, Tamil Nadu, India Epam Full time

    EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most...

  • Big Data Architect

    1 week ago


    Chennai, Tamil Nadu, India Databricks Full time

    CSQ225R66As aResident Solutions Architectin our Professional Services team you will work with clients on short to medium term customer engagements on theirbig data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Data Engineer

    2 months ago


    Chennai, Tamil Nadu, India Mobile Programming LLC Full time

    Job Role :Mobile Programming is looking for an experienced data engineer who will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. You should have strong analytical skills and...

  • Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Mobile Programming LLC Full time

    Job Role :Mobile Programming is looking for an experienced data engineer who will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. You should have strong analytical skills and...


  • Chennai, Tamil Nadu, India Databricks Full time

    CSQ225R24 As a Resident Solutions Architect in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Big Data Developer

    1 week ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable Big Data applications using Hadoop ecosystem technologies (Hadoop, HDFS, Hive, etc.). Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement...

  • Big Data Developer

    1 week ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable Big Data applications using Apache Spark. Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...

  • Big Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India Anicalls (Pty) Ltd Full time

    2 to 5 years hands-on Experience on Spark Core, Spark-SQL, Scala-Programming, and Streaming datasets in Big Data platform Should have extensive working experience in Hive and other components of the Hadoop ecosystem (HBase, Zookeeper, Kafka, and Flume) Should be able to understand the complex transformation logic and translate them to Spark-SQL queries....

  • Big Data Lead

    1 week ago


    Chennai, Tamil Nadu, India Hexaware Technologies Full time

    :Expert in Snowflake implementations (with 7 to 10 years in Cloud/Data industry)7+ years' experience in cloud data engineering experience5+ years strong experience in SQL, stored procedures, ELT in Snowflake Environment.2+ years of experience in Python development for Data engineering.Experience cloud/on-prem devops tools for orchestration, scheduling,...

  • Big Data Tester

    1 week ago


    Chennai, Tamil Nadu, India CGI Full time

    Position Description:At CGI, we're a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72, professionals located in 40 countries. Founded in , CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources, expertise,...


  • Chennai, Tamil Nadu, India Anicalls (Pty) Ltd Full time

    Candidate should be able to: This solution enables our Data Scientists and Data Analysts to actively detect trends, patterns, and relationships in data sets.engage in the enhancement and maintenance support of data movement solutions to meet client business objectives and will have an opportunity to work with a cross-disciplinary team.Contribute to the data...


  • Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Job Title: Big Data ETL Tester at [Company Name]Responsibilities : Design and develop test specifications based on various requirement documents for scheduled execution. Conduct both functional and technical testing of ETL jobs, utilizing automation tools whenever possible. Utilize your indepth knowledge of Big Data ETL to identify and design effective test...

  • Big Data

    1 week ago


    Chennai, Tamil Nadu, India Nityo Infotech Full time

    Big Data , Data , Description , Job , Level , Location , Pune , Scala , SparkExperience Required 12 YearsIndustry TypeITEmployment TypePermanentLocationIndia

  • Big Data Internship

    1 month ago


    Chennai, Tamil Nadu, India Gateway Software Solutions Full time

    About the internship:As a Big Data intern at Gateway Software Solutions, you will have the opportunity to work with cutting-edge technology and gain hands-on experience in the dynamic world of data analytics. You will be a key member of our team, contributing to the development and implementation of data-driven solutions for our clients. Selected intern's...

  • Big Data Internship

    1 week ago


    Chennai, Tamil Nadu, India Gateway Software Solutions Full time

    About the internship:As a Big Data intern at Gateway Software Solutions, you will have the opportunity to work with cutting-edge technology and gain hands-on experience in the dynamic world of data analytics. You will be a key member of our team, contributing to the development and implementation of data-driven solutions for our clients. Selected intern's...