Summary
We are looking for a Databricks Administrator to join our Data and Analytics team to manage the Databricks infrastructure on our Cloud Data Analytics Platform. You will provide admin support to engineering and operations teams and assist in the planning of deployments in multiple environments.
Your role in our mission
-
Deploy, support, and administer the Databricks Lakehouse in the Cloud including but not limited to:
- Memory Management
- Handle scheduling queues & messages
- Performance Management
- Supervise cluster health checks
- Regular back up & recovery
- Node commissioning & decommissioning
- Code deployments
- Server log analysis
- Manage tenants including workspace creation, user management, cloud resources, and account usage monitoring
- Advise on architecture and scaling for Databricks environments
- Collect user requirements and set up data storage, notebooks, and compute to fulfill business use cases
- Serve as a point of contact for technical issues in the environment
- Monitor usage, report on cost management, and participate in cost planning
What we're looking for
- Bachelor’s degree (or equivalent) in computer science or related discipline
- 3.6+ years experience in data administration, from setting up the Databricks environment to successfully administering it
- Proven experience as the Databricks account owner, managing workspaces, audit logs, and high-level usage monitoring
- Experience managing cluster and jobs configuration options
- Coding skills in SQL and Python (PySpark) with experience optimizing code
- Experience with Amazon Web Services (AWS)
- Proven ability to meet established service levels, availability, performance, data privacy, and security guidelines is necessary
What you should expect in this role
- Opportunities to travel through your work (0-10%)
नौकरी रिपोर्ट करें
