Hadoop Architect

Experience: Minimum10 years

· Monitor and resolve HDFS and Ozone related issues.

· Investigate cluster performance, storage utilization, and capacity concerns.

· Manage quota requests, storage allocation, and capacity planning.

· Support platform maintenance and perform integration activities.

· Coordinate with application teams during incident and problem management.

· Create and maintain operational documentation, runbooks, and knowledge articles.

· Strong experience with the Hadoop ecosystem:

o HDFS

o Hive

o Spark

o Ozone

· Hive Metastore management and table/partition maintenance.

· Hadoop data lifecycle management.

· Data ingestion, ETL processes, and data validation.

· Shell scripting and Python automation.

· Cloudera Data Platform (CDP) or similar Hadoop distributions.

· Strong SQL and data analysis skills.

· Experience supporting large-scale Hadoop environments with multi-petabyte storage.

· Knowledge of distributed storage architecture and data replication.

· Capacity management, storage forecasting, and quota governance.

· Platform onboarding, integration, and decommissioning.

· Familiarity with cloud platforms (Azure, AWS, or GCP).

· Experience with monitoring tools such as Cloudera Manager, Grafana, Splunk, or Prometheus.

· Strong analytical and problem-solving skills with root cause analysis.

Assessment Based on what you’ve shared with me previously, this role aligns well with your background in:

· Hadoop administration and platform support · HDFS and Ozone · Hadoop migration and enablement

· SQL

· Python

· Grafana and Prometheus

· Enterprise production support It looks like a good match if you’re applying for a Senior Hadoop Administrator, Hadoop Platform Engineer, or Big Data Support Engineer position.

If this is for an interview, I can also prepare:

The top 50 interview questions with answers for this exact job description.

Scenario-based production support questions.

A resume tailored specifically to this role.

Discretionary Annual Incentive.

Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.

Family Support: Maternal & Parental Leaves.

Insurance Options: Auto & Home Insurance, Identity Theft Protection.

Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.

Time Off: Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Range: $95,000 - $115,000 a year