Big Data Engineer

3 days ago

Bengaluru Chennai Noida, India Anlage Infotech Full time ₹ 15,00,000 - ₹ 20,00,000 per year

Role: Big Data Scala

Location: Bangalore, Noida, Gurgaon, Pune, Mumbai, Hyderabad - Hybrid 3 Days in a Week

Exp: 5+ Years

and 7+ Years

Immediate Joiners Only

Note: One F2F round of interview is Mandatory at any Publicis Sapient office

JD:

Must have skills:

1. Knowledge of Spark, Scala and conversant with SQL

2. Reverse engineer the SQL queries, Scala code to understand functionality

3. Capable of identifying, analysing and interpret patterns and trends in complex data sets

4. Has worked on creating database design, data models & techniques for data mining.

Detailed Requirements:

1. Using automated tools to extract data from primary and secondary sources

2. Removing corrupted data and fixing coding errors and related problems

3. Performing analysis to assess quality and meaning of data

4. Filter Data by reviewing reports and performance indicators to identify and correct code problems

5. Using statistical tools to identify, analyze, and interpret patterns and trends in complex data sets that could be helpful for the diagnosis and

  1. prediction
  2. Assigning numerical value to essential business functions so that business performance can be assessed and compared over periods of time.
  3. Analyzing local, national, and global trends that impact both the organization and the industry
  4. Preparing reports for the management stating trends, patterns, and predictions using relevant data
  5. Working with programmers, engineers, and management heads to identify process improvement opportunities, propose system modifications, and devise data governance strategies.
  6. Preparing final analysis reports for the stakeholders to understand the data-analysis steps, enabling them to take important decisions based on various facts and trends.
  7. Knowledge of programming languages like SQL, Oracle, R and Python
  8. Technical proficiency regarding database design development, data models, techniques for data mining, and segmentation.
  9. Experience in handling reporting packages like Business Objects, programming (JavaScript, XML, or ETL frameworks), databases
  10. Proficiency in statistics and statistical packages like Excel, SPSS, SAS to be used for data set analyzing
  11. Adept at using data processing platforms like Hadoop and Apache Spark
  12. Knowledge of data visualization software like Tableau, Qlik
  13. Knowledge of how to create and apply the most accurate algorithms to datasets in order to find solutions
  14. Data mapping (ACRS, MARSHA) creation & maintenance, track open questions, issues, and support on all ongoing epics with data related queries

Good to have skills:

1. Adept at using data processing platforms like Hadoop and CouchDB

2. Performing analysis to assess quality and meaning of data

3. Preparing reports for the management stating trends, patterns, and predictions using relevant data

  • Big Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeBigDataEngineer Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems using Hadoop.Responsibilities:• Design, develop, and deploy big data solutions using Hadoop, Spark, and Scala.•...

  • Big Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Insight Global Full time

    Position: Big Data EngineerDuration: 12+ monthsLocation: India - Chennai or GurgaonRate: 4-17 LPARequired Skills & ExperienceAt least 6+ Years of experience with PySpark and MapRProgramming background with PythonExperience with SQL (Relational Databases) doing data modeling, Oracle experience is a plus.Experience with PowerBI and/or TableauJob...

  • Big Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Insight Global Full time

    Position: Big Data EngineerDuration: 12+ monthsLocation: India - Chennai or GurgaonRate: 4-17 LPARequired Skills & ExperienceAt least 6+ Years of experience with PySpark and MapRProgramming background with PythonExperience with SQL (Relational Databases) doing data modeling, Oracle experience is a plus.Experience with PowerBI and/or TableauJob...

  • Big Data Engineer

    3 days ago

    Bengaluru, Chennai, Pune, India Brillio Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Title: Big Data EngineerRole OverviewWe are seeking a highly skilled Big Data Engineer to join our team.The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distributed data processing systems. This role involves working closely with cross-functional teams to ensure the reliability,...

  • Big Data Engineer Position

    4 days ago

    Chennai, Bengaluru / Bangalore, India beBeebigData Full time ₹ 1,04,000 - ₹ 1,30,878

    Big Data Engineer OpportunityWe are seeking a skilled Big Data Engineer to join our team. 4+ years of experience in Big Data technologies.This is a permanent position with competitive benefits.Our company offers a dynamic work environment and opportunities for growth and development.

  • Big Data Engineering Leader

    6 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a highly skilled professional to lead our data engineering initiatives. As a Big Data Engineer, you will be responsible for designing and developing large-scale data processing systems.Key Responsibilities:Design and implement scalable data pipelines using PySpark and HiveDevelop and maintain big data applications using Spark, HBase, and DQ...

  • Big Data Engineer

    4 days ago

    Noida, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 25,00,000

    Big Data EngineeringAt the forefront of big data processing lies a complex web of systems, tools and workflows. To engineer such processes requires expertise in multiple areas, including data flow platforms, workflow management and large dataset integration.Our ideal candidate will possess hands-on experience with Apache Spark, utilizing Scala for...

  • Senior Big Data Engineer

    2 weeks ago

    Noida, Bengaluru / Bangalore, India beBeeData Full time US$ 90,000 - US$ 1,20,000

    Big Data EngineerWe are seeking an experienced Big Data Engineer to join our team. The successful candidate will have strong technical skills and experience working with big data technologies such as Hadoop, Spark, and Kafka.The ideal candidate will have a strong understanding of cloud-based big data platforms and be able to design, implement, and manage...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Coders Brain Full time

    Job DescriptionRoles and Responsibilities:- Develop scalable infrastructure and platform to collect, analyze and process large amounts of structured and unstructured data with real-time data interpretation.- Work closely across an array of various teams and organizations in the company (including partners, customers)Basic Qualifications:- Bachelor's degree...

  • Big Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Reveille Technologies,Inc Full time ₹ 1,04,000 - ₹ 13,39,200 per year

    We're Hiring: Big Data Engineer – Full-TimeLooking for a skilledBig Data Engineerto join our team inBangaloreRole: Big Data EngineerGrade: G4 |TSRLocation: Bangalore (Onsite/Hybrid – specify if needed)Budget: ₹13,39,200Experience: 4–6 yearsSkills:Azure Databricks (ADB)PySparkSQLSpark (Scala/Python)TerraformAirflow & KubernetesData Warehousing &...