Big Data Engineer

1 week ago


Chennai, Tamil Nadu, India Anicalls (Pty) Ltd Full time

  • 2 to 5 years hands-on Experience on Spark Core, Spark-SQL, Scala-Programming, and Streaming datasets in Big Data platform
  • Should have extensive working experience in Hive and other components of the Hadoop ecosystem (HBase, Zookeeper, Kafka, and Flume)
  • Should be able to understand the complex transformation logic and translate them to Spark-SQL queries.
  • Unix Shell Scripting and setting up CRON
  • Familiar with Data Warehouse concepts and Change Data Capture (CDC and SCD Types)
  • Should have worked on Cloudera distribution framework, Oozie Workflow (or any Scheduler), Jenkins (or any version controller).
  • Prior Experience in Consumer Banking Domain is an advantage.
  • Prior Experience in the agile delivery method is an advantage.
  • Excellent understanding of technology life cycles and the concepts and practices required to build big data solutions
  • Core Java skillset is an added advantage. Airflow is an added advantage.
  • Good Knowledge and Experience in any database (Teradata or Data Lake or Oracle or SQL Server) is a plus.

  • Big Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India ADVANSOFT Full time

    We are hiring for Data engineer with top most MNC client;Exp : 5+yearsNp : immediate to 15daysLocation : & Responsibilities : 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies. Experience working with Databases like...

  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Hiring Infinity Full time

    Role : Data EngineerWe are looking for a curious Data Engineer to join our extremely fast growing Tech Team About the organization :Founded in 2021, leverages GenAI to enable businesses to effortlessly create and launch ads in seconds.Businesses can manage ads across channels like Facebook, Instagram, Google and WhatsApp in a single platform.Proprietary...

  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Hiring Infinity Full time

    Role : Data EngineerWe are looking for a curious Data Engineer to join our extremely fast growing Tech Team About the organization :Founded in 2021, leverages GenAI to enable businesses to effortlessly create and launch ads in seconds.Businesses can manage ads across channels like Facebook, Instagram, Google and WhatsApp in a single platform.Proprietary...

  • Manager (Big Data)

    2 weeks ago


    Chennai, Tamil Nadu, India Databricks Full time

    CSQ325R53As aBig Data Managerin our Professional Services team you will work with clients on short to medium term customer engagements on theirbig data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to...

  • Architect - Big Data

    2 weeks ago


    Chennai, Tamil Nadu, India Databricks Full time

    CSQ125R88As anArchitect (Big Data)in our Professional Services team you will work with clients on short to medium term customer engagements on theirBig Data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...

  • Big Data Architect

    1 week ago


    Chennai, Tamil Nadu, India Databricks Full time

    CSQ125R88As anArchitect (Big Data)in our Professional Services team you will work with clients on short to medium term customer engagements on theirBig Data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...


  • Chennai, Tamil Nadu, India Epam Full time

    EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most...

  • Big Data Architect

    1 week ago


    Chennai, Tamil Nadu, India Databricks Full time

    CSQ225R66As aResident Solutions Architectin our Professional Services team you will work with clients on short to medium term customer engagements on theirbig data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Data Engineer

    2 months ago


    Chennai, Tamil Nadu, India Mobile Programming LLC Full time

    Job Role :Mobile Programming is looking for an experienced data engineer who will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. You should have strong analytical skills and...

  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Mobile Programming LLC Full time

    Job Role :Mobile Programming is looking for an experienced data engineer who will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. You should have strong analytical skills and...


  • Chennai, Tamil Nadu, India Databricks Full time

    CSQ225R24 As a Resident Solutions Architect in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Big Data Developer

    2 weeks ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable Big Data applications using Hadoop ecosystem technologies (Hadoop, HDFS, Hive, etc.). Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement...

  • Big Data Developer

    2 weeks ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable Big Data applications using Apache Spark. Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...

  • Big Data Lead

    1 week ago


    Chennai, Tamil Nadu, India Hexaware Technologies Full time

    :Expert in Snowflake implementations (with 7 to 10 years in Cloud/Data industry)7+ years' experience in cloud data engineering experience5+ years strong experience in SQL, stored procedures, ELT in Snowflake Environment.2+ years of experience in Python development for Data engineering.Experience cloud/on-prem devops tools for orchestration, scheduling,...

  • Big Data Tester

    2 weeks ago


    Chennai, Tamil Nadu, India CGI Full time

    Position Description:At CGI, we're a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72, professionals located in 40 countries. Founded in , CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources, expertise,...


  • Chennai, Tamil Nadu, India Anicalls (Pty) Ltd Full time

    Candidate should be able to: This solution enables our Data Scientists and Data Analysts to actively detect trends, patterns, and relationships in data sets.engage in the enhancement and maintenance support of data movement solutions to meet client business objectives and will have an opportunity to work with a cross-disciplinary team.Contribute to the data...


  • Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Job Title: Big Data ETL Tester at [Company Name]Responsibilities : Design and develop test specifications based on various requirement documents for scheduled execution. Conduct both functional and technical testing of ETL jobs, utilizing automation tools whenever possible. Utilize your indepth knowledge of Big Data ETL to identify and design effective test...

  • Big Data

    1 week ago


    Chennai, Tamil Nadu, India Nityo Infotech Full time

    Big Data , Data , Description , Job , Level , Location , Pune , Scala , SparkExperience Required 12 YearsIndustry TypeITEmployment TypePermanentLocationIndia

  • Big Data Internship

    1 month ago


    Chennai, Tamil Nadu, India Gateway Software Solutions Full time

    About the internship:As a Big Data intern at Gateway Software Solutions, you will have the opportunity to work with cutting-edge technology and gain hands-on experience in the dynamic world of data analytics. You will be a key member of our team, contributing to the development and implementation of data-driven solutions for our clients. Selected intern's...

  • Big Data Internship

    1 week ago


    Chennai, Tamil Nadu, India Gateway Software Solutions Full time

    About the internship:As a Big Data intern at Gateway Software Solutions, you will have the opportunity to work with cutting-edge technology and gain hands-on experience in the dynamic world of data analytics. You will be a key member of our team, contributing to the development and implementation of data-driven solutions for our clients. Selected intern's...