Big Data Engineer

5 days ago

Bengaluru Chennai Noida, India Anlage Infotech Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Role: Big Data Scala

Location: Bangalore, Noida, Gurgaon, Pune, Mumbai, Hyderabad - Hybrid 3 Days in a Week

Exp: 5+ Years

and 7+ Years

Immediate Joiners Only

Note: One F2F round of interview is Mandatory at any Publicis Sapient office

JD:

Must have skills:

1. Knowledge of Spark, Scala and conversant with SQL

2. Reverse engineer the SQL queries, Scala code to understand functionality

3. Capable of identifying, analysing and interpret patterns and trends in complex data sets

4. Has worked on creating database design, data models & techniques for data mining.

Detailed Requirements:

1. Using automated tools to extract data from primary and secondary sources

2. Removing corrupted data and fixing coding errors and related problems

3. Performing analysis to assess quality and meaning of data

4. Filter Data by reviewing reports and performance indicators to identify and correct code problems

5. Using statistical tools to identify, analyze, and interpret patterns and trends in complex data sets that could be helpful for the diagnosis and

  1. prediction
  2. Assigning numerical value to essential business functions so that business performance can be assessed and compared over periods of time.
  3. Analyzing local, national, and global trends that impact both the organization and the industry
  4. Preparing reports for the management stating trends, patterns, and predictions using relevant data
  5. Working with programmers, engineers, and management heads to identify process improvement opportunities, propose system modifications, and devise data governance strategies.
  6. Preparing final analysis reports for the stakeholders to understand the data-analysis steps, enabling them to take important decisions based on various facts and trends.
  7. Knowledge of programming languages like SQL, Oracle, R and Python
  8. Technical proficiency regarding database design development, data models, techniques for data mining, and segmentation.
  9. Experience in handling reporting packages like Business Objects, programming (JavaScript, XML, or ETL frameworks), databases
  10. Proficiency in statistics and statistical packages like Excel, SPSS, SAS to be used for data set analyzing
  11. Adept at using data processing platforms like Hadoop and Apache Spark
  12. Knowledge of data visualization software like Tableau, Qlik
  13. Knowledge of how to create and apply the most accurate algorithms to datasets in order to find solutions
  14. Data mapping (ACRS, MARSHA) creation & maintenance, track open questions, issues, and support on all ongoing epics with data related queries

Good to have skills:

1. Adept at using data processing platforms like Hadoop and CouchDB

2. Performing analysis to assess quality and meaning of data

3. Preparing reports for the management stating trends, patterns, and predictions using relevant data

  • Big Basket

    2 weeks ago

    Bengaluru, India big basket Full time

    What would you be doing/ Expected from this role ?- Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.- Drive the architecture of machine learning pipelines from data collection and preprocessing to model training, evaluation, and deployment.- Implement scalable machine learning...

  • Big Data

    6 days ago

    Noida, India Iris software Full time

    JD: - Minimum EAP experience - 7 years.- Responsibilities for Big Data Engineer- Perform data cleaning, integration, validation and analysis - Extensive experience of developing(must), deploying (must) and maintaining(must) the Big Data Ecosystem - Create and maintain optimal data pipeline architecture - Assemble large, complex data sets that meet...

  • Big Data Engineer

    5 days ago

    Bengaluru, Chennai, Pune, India Brillio Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Title: Big Data EngineerRole OverviewWe are seeking a highly skilled Big Data Engineer to join our team.The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distributed data processing systems. This role involves working closely with cross-functional teams to ensure the reliability,...

  • Big Data Engineer

    2 days ago

    Bengaluru, India Acme Services Full time

    Job Description We are actively seeking a skilled Big Data Engineer to join our client's dynamic team through Acme Services. This pivotal role requires solid experience in ETL / Data Engineering / Data Warehousing principles. The ideal candidate will possess strong proficiency in Python, PySpark, and SQL or other ETL tools, along with hands-on experience in...

  • Big Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases. Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis. Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate...

  • Big Data Engineer

    1 week ago

    Bengaluru, India Tata Consultancy Services Full time

    Job Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per year

    Job Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...

  • Big Data

    2 days ago

    Bengaluru, India Teamware Solutions Full time

    Job Description Teamware Solutions is seeking a talented and passionate Big Data Engineer with 2-4 years of experience to join our dynamic team. This role is crucial for designing, developing, implementing, and troubleshooting scalable Big Data solutions that process, store, and manage large volumes of diverse data. The successful candidate will contribute...

  • Big Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Reveille Technologies,Inc Full time ₹ 16,00,000 - ₹ 24,00,000 per year

    We're Hiring: Big Data Engineer – Full-TimeLooking for a skilledBig Data Engineerto join our team inBangaloreRole: Big Data EngineerGrade: G4 |TSRLocation: Bangalore (Onsite/Hybrid – specify if needed)Budget: ₹13,39,200Experience: 4–6 yearsSkills:Azure Databricks (ADB)PySparkSQLSpark (Scala/Python)TerraformAirflow & KubernetesData Warehousing &...

  • Big Data Engineer

    5 days ago

    Chennai, Hyderabad, India Orcanexgen Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    BigData EngineerHyderabad, ChennaiHybrid mode5+ years of experienceJob Description:Highly skilled Big Data Engineer with expertise in distributed systems, and advanced programming techniques. Candidate will possess experience in developing highly scalable Big Data pipelines, strong technical knowledge, thought leadership, and a passion for creating...