Big Data Tester

6 days ago

Chennai, India Durus Consulting Private Limited Full time

**JOB DESCRIPTION FOR BIG DATA ENGINEER**

**Job Role ** : Big Data Testing

**Job Type** : FTE

**Location** : Hybrid

**Notice Period** : Immediate to 30 days

**Experience ** : 3+ YRS

**Desired Skills and Experience.**
- Demonstrated testing & automation experience of 3-6 Years in Big data technology stack - Hadoop, HDFS & Spark
- Good understanding of Hive concepts and knowledge of NoSQL DB preferable
- Proficient in writing complex SQL, Hive QL and Spark QL queries
- Ability to test software & get UAT done from business users in Agile manner
- Continuous automation to increase test coverage and efficiency
- Proactive & reactive support in deployments & production environment
- Expert in one of the scripting languages such as Python/Shell/Perl.
- Hands on experience in Linux or Unix
- Good debugging skills
- Proficient understanding of distributed computing principles
- Management of Hadoop cluster and spark, with all included services
- Ability to solve any ongoing issues with operating the cluster
- Proficiency with Hadoop v2, MapReduce, HDFS
- Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
- Experience with integration of data from multiple data sources
- Experience with NoSQL databases, such as HBase, MongoDB
- Added advantage with BI tools like PowerBI and Tableau
- Knowledge of various ETL techniques and frameworks, such as Flume
- Experience with various messaging systems, such as Kafka or RabbitMQ
- Experience with Big Data ML toolkits, such as Mahout, SparkML
- Good understanding of Lambda Architecture, along with its advantages and drawback

**Job Types**: Full-time, Regular / Permanent

**Salary**: ₹291,203.91 - ₹1,000,000.00 per year

Schedule:

- Day shift
- Morning shift

Ability to commute/relocate:

- Chennai, Chennai - 600096, Tamil Nadu: Reliably commute or planning to relocate before starting work (required)

**Education**:

- Bachelor's (preferred)

**Experience**:

- Big data: 4 years (required)
- SQL: 1 year (required)
- Hadoop: 1 year (required)
- HDFS: 1 year (required)
- Cloud: 1 year (required)

**Speak with the employer**
+91 7200098547

  • Big Data Tester

    6 days ago

    Chennai, Tamil Nadu, India Warrior tech solutions Full time

    Hi, Greetings from eWarriors Tech Solutions. **Role: Big Data Tester** **Location: Chennai/Bangalore (Onsite)** *** **Experience: 4+ years** **Skills and Qualifications**: - Hands-on experience with Big Data tools (e.g., Hadoop, Spark, Hive). - Proficient in SQL for data validation and querying. - Familiarity with scripting languages (e.g., Python,...

  • Big Data

    1 week ago

    Chennai, Tamil Nadu, India Tata Consultancy Services (TCS) Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Role: Big data EngineerExperience: 6 to 8 YearsLocation: Chennai/Mumbai/Pune Skills:Big DataPysparkHiveLocationChennaiJob FunctionTECHNOLOGYRoleDeveloperJob Id373773Desired SkillsDigital : PySpark | Big Data | HiveDesired Candidate ProfileQualifications : BACHELOR OF ENGINEERING, BACHELOR OF TECHNOLOGY

  • ETL tester

    2 weeks ago

    Chennai, Tamil Nadu, India Novature Tech Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Keywords:ETL Testing Python PysparkExperience:5 - 10 yearsDesignation / Role:ETL TesterLocation:ChennaiJob Description:ob Overview We are seeking a skilled ETL Tester with strong expertise in Python and PySpark to join our QA team. The role involves validating large-scale data pipelines, ensuring data quality, and automating test processes in modern data...

  • Big Data

    2 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Greetings from TCS!TCS is hiring for Big Data Required Technical Skill Set -MS Azure Cloud Platform, Big Data with Hadoop, Python, Hive, Azure data and admin analysisLocation: - ChennaiDesired Experience Range: 5 to 12 yearsMust to HaveHands on experience in installation, configuration, supporting and managing Hadoop clusters using Hortonworks...

  • Big Data

    2 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Greetings from TCS!TCS is hiring for Big DataRequired Technical Skill Set -MS Azure Cloud Platform, Big Data with Hadoop, Python, Hive, Azure data and admin analysisLocation: - ChennaiDesired Experience Range: 5 to 12 yearsMust to HaveHands on experience in installation, configuration, supporting and managing Hadoop clusters using Hortonworks...

  • Big Data Engineer

    2 days ago

    Chennai, India Saaki Argus & Averil Consulting Full time

    Hiring for Big Data: LOCATION: Chennai, Bengaluru, Hyderabad. EXPERIENCE: 7-10 Notice Period : Immediate Joiner or 30 Day Key Skills Hands-on experience on technologies like Python, SQL, Snowflake, HDFS , Hive, Scala, Spark, AWS, HBase and Cassandra. Good knowledge in Data Warehousing concepts. Proficient in Hadoop distributions such as Cloudera,...

  • Big Data Engineer

    3 days ago

    chennai, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases. Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis. Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate...

  • Big Data Developer

    2 days ago

    Chennai, India Chiselon Technologies Pvt Ltd Full time

    Hiring!!! We are hiring for one of our client!!! Position - Big Data Engineer Experience - 5+years Location - Chennai, Bangalore Work Mode - Hybrid Notice Period - Immediate Joiners(Seving Notice Period within 15days only) Job Overview We are seeking a skilled Big Data Developer to join our team in a mid-level position. This full-time , hybrid role is based...

  • Big Data Developer

    1 week ago

    Chennai, Tamil Nadu, India Chiselon Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    HiringWe are hiring for one of our clientPosition - Big Data Engineer Experience - 5+yearsLocation - Chennai, BangaloreWork Mode - HybridNotice Period - Immediate Joiners(Seving Notice Period within 15days only)Job OverviewWe are seeking a skilled Big Data Developer to join our team in a mid-level position. This full-time, hybrid role is based in Chennai...

  • Big Data

    2 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Greetings from TATA CONSULTANCY SERVICES!WALK-IN-DRIVE "Big Data"Interview Date: 8th November 2025Years of Experience: 5 - 10 yearsLocation: ChennaiJob Description:-Hands on experience in installation, configuration, supporting and managing Hadoop clusters using Hortonworks distributionHands on experience on clusters migration /Azure CloudUpgrading the...