職位要求???
??熟練掌握Hive、Spark、HBase等大數(shù)據(jù)技術(shù)，SQL和數(shù)據(jù)處理能力優(yōu)秀
?
熟練掌握Python，深入了解軟件設(shè)計模式。
?????????
??資深大數(shù)據(jù)數(shù)倉開發(fā)經(jīng)驗
?
資深A(yù)zure云產(chǎn)品開發(fā)實施經(jīng)驗
?????????
??有數(shù)據(jù)調(diào)度設(shè)計實施經(jīng)驗，最好熟練使用Airflow
?
熟悉數(shù)據(jù)倉庫方法論、理解維度建模
?
????????職位描述???
??負責(zé)制定端到端基于Azure云上Hive,?Airflow的ETL詳細設(shè)計
?
負責(zé)領(lǐng)導(dǎo)、實施Airflow開發(fā)
?
負責(zé)領(lǐng)導(dǎo)、實施Hive?ETL開發(fā)
?
????????????Senior?Big?Data?Engineer???
??Job?Requirements???
??Advanced?in?Hive,?Spark,?HBase?and?other?big?data?technologies,?Skilled?in?SQL?and?data?processing
?
Advanced?in?Python.?Knowledgeable?on?software?design?patterns
?
Deep?experiences?in?DW/ETL?development?using?big?data?technologies
?
Deep?implementation?experiences?in?using?Azure?cloud?services
?
Proficient?in?data?orchestration?design?and?implementation,?proficient?in?Airflow?is?a?plus
?
Familiar?with?dimensional?modelling?methodology
?
????????????????????????Job?Description???
??Responsible?for?leading?the?E2E?low-level?ETL?design?under?Airflow?and?HDInsight?technologies?in?Azure.
?
Responsible?for?leading?the?HDInsight?DW?development.
?
Responsible?for?leading?the?Airflow?development.
