Databricks Solutions Architect

What you will be doingBe a core member of our rapidly growing Databricks practiceWork directly with end customers and architect, scope, negotiate & lead enterprise scale Databricks migration projectsProvide thought leadership in the areas of data migration, master data management, data modeling, data governance, data transformations, curation and data integrationDevelop data architecture blueprints, patterns and frameworks that will enable reuse and standardizationGrow the practice by influencing sales deals and assist with scoping, solutioning and estimating effortLead efforts to develop reusable frameworks, accelerators and internal product developmentHelp us hire, train and develop highly differentiated and diverse team of Big Data expertsThe skills you will bring7+ years experience of data engineering, data platforms &analytics.10+ years of consulting experienceMinimum 6-8+ projects delivered with hands-on experience in development on databricks.Current knowledge across the Databricks product *& platform features - and/ or complete Databricks Data Engineering Professional Certification (upon joining).Deep understanding and experience working with modern cloud data architectures and engineering for one or more of the common cloud ecosystems - AWS, Azure or GCPFamiliarity with cloud native technologies specifically - Python / PySpark/ JavaScript, CI/CD for production deployments , ML Ops, cloud devops, containers (kubernetes/docker, etc.)Deep experience with distributed computing with Spark, with knowledge of Spark runtime intervals.Strong abilities to provide a firm point of view on core cloud platform capabilities, security, and best practicesKnowledge of cloud and Big Data ecosystems to advise clients on optimal solutions and best practicesUnderstanding of cloud data architecture and data integration patterns (Databricks, Starburst, Azure Data Factory, AWS Glue and others), storage and processing (Redshift, Azure Synapse, BigQuery, Snowflake); Infrastructure as code (CloudFormation, Terraform)Understanding of enterprise data concepts such as Master Data Management and Enterprise Data Warehouse, experience with MDM standardsUnderstanding of SQL, report generation using visualization tools such as Tableau/Power BI, programming using Python/Scala/SparkAbility to identify, debug bottlenecks and significantly optimizes low running data pipelinesExperience migrating applications from legacy Hadoop or Data Warehouses to the cloud running Apache Spark or Databricks a huge plusOther nice to have skills:Demonstrating prior Big 4 or proven consulting experience in strategy through execution projects is a plusExperience leading and working with large Cloud Data Platform, Cloud Data migration or Enterprise Information Management programsYou bring an uncompromising Growth mindsetYou are highly motivated, creative in your approach to technical problems and know how to leverage both internal and external networksYou invest in keeping technical skills updated and are constantly looking for the next big challengeYou will bring both broad and deep knowledge in Data Engineering and can architect a solution by mapping a customer business problem to an end-to-end solution.You are resourceful, confident and composed under pressure