| Requirement | PYM Requirements / |
| Operations | Capacity Planning Doc Ajay (2013) , Chiru (2014) / Srini APT Grid/Oracle comparison doc , copy/ Reprocess Request / |
| Design Docs | List / Grid ETL To Do / UDFs / ETL Design Doc APT / Raja's G2O Alternative / Raja's PL SQL Standards / PYM Design Doc / Purge HDFS Files / APT Design / PYM UAD Twiki (DO NOT SHARE OUTSIDE UAD) / Ajay's refactoring doc / Refactor Pig Params / Managing Namespace Quota / Consuming RevSP Field / Ajay's doc about removing sequence numbers / Raja Oracle HDFS Framework / UAD Data Model / yo/uadDataMpdel / |
| Hadoop POC: Hadoop POC Anton Doc / Hadoop POC Operational Doc | |
| Mobile: Main , Mobile Reporting , A41 , Mobile Revenue Fields , Dimension Tables , PKG_FACT_REVN_BOOK_TRAF_MON_A40 , Data Profiling / | |
| Misc: | Chiru Doc on All Grid Aggregagtes / Gemini Tool / Automation of Schema / SpaceId,AsPosition Req Doc / No Ad Fallout Design Doc / Chiru Doc on Archival Utility / Ad Proeduct Classification/ Jacob's Doc on Ad Product Classification / |
| NO Ads | Total Supply Calc / Another Total Supply / Another Total Supply Doc / Point Guard No Ad Req / |
| Nest | NEST Intro / Aparna Presentation / Nest Naming / Data Feed Feedback / |
| YAXR | Doc Link / Anton Data Feed Specs (Good) / 3PS DSP on YAXR Data Feed / RMX on RMX Data Feed / YAMP on YAXR Data Feed / UAD Design Publisher Hierarchy / YAXv Dimension Mapping / |
| BrightRoll | Story ADUAD-588 / Anton Docs / Bright Roll Requirements / Feed Spec / Kathir's Integration Checklist / |
| Cost and Profit | Story ADUAD-586 / Design / Requirements / Data Calculation / DB Columns and Metrics / Anton spec (Same as Self Serve) / Anton Data Model (Same as SS) / Raja Doc on 3P / |
| Curveball | General Google Docs Home / Srini's doc about Pub Blob / Arnold Deck / UAD Curveball Data Feed / Curveball Data Model / Curveball Data Workflow / Curveball Logical Domain Model / Jacob's Analysis of Curveball / Dimensions / Internationalization / |
| Phase 1: Revenue Design, Schema, Sample / Traffic Design, Flurry Changes, Schema, Sample / | |
| Phase 2 (Dim): COW Docs / Onboarding / Schema / Examples / Ankur Code Pig, Unit Test, Maven Dependency / CB Dim Plan / CB Dim Design / Data Mapping / CB Dim Json / Changes for Channel / Bugs | Cow Extracts / E2E Testing / Dim Mapping / Raja Doc | |
| Gemini Gemini Bible / Jive Community / | |
| YAM+ | Intro Video / YAMP User Guide / Yam+ Twiki / Kite 1.7 / Data Model Twiki / Anton Spec Folder / Dimension Mapping / OFA Feed Specs / Design / Schema / Mike's Feed Spec Doc / Yam Plus Booking / Yam/Yam+ Projected Revenue / |
| Yam+ Self Serve | Story ADUAD-587 / Design (Same as Cost Profit) / Story and Acceptance / Anton spec / Anton Data Model / Anton Data Model and ETL / |
| All Star | New Fields Highlighted / Deck / Kite specs / UAD and APT fields / E2E Doc / Anton's specs / |
| Point Guard/Federated | Pointguard Deck , Overview / Design Doc / RMX Federation / UML Diagram / |
| PYM | Presentation / Meeting Notes / |
| Unit Test Fwk | Radhika doc on data generationTest Framework doc , Test Framework control |
| Trading Pit | Docs Home / Phase 1 Doc / Phase 1 Use Cases / Video Session / Main Twiki / |
| Search Integration | Search Int Project 2 / Search Integration design doc / Jyothi Requirement Doc / Anton Requirement Spreadsheet / Anton Spec for Search / |
| Apollo: Search Data Model / Low Latency Reporting Design / CTZ Fact Redesign / Another / | |
| Base Metrics | Design , Feed Info , Schema / Currency Lookup / |
| RMX | RMX Tech Talks / |
| Pryme Instances | Prod / Staging / Dev / Calendar / EMEA Calendar / |
| Pryme Docs | Assignments / Product Overview Deck / Overview 2 / Pricing Target Q1 2015 / Roles Doc / Project Grandview |
| Architecture Logical , Backend, | |
| Pricing Overview / Pricing Server Integration / Inventory Docs / Toruk Consolidated Doc / | |
| Analytics/YAM+ Summary - UAD Query / YAM + Dasnboard Use Cases / | |
| Operations PRYME Roles / Env and Servers / SOX and CD / | |
| Training Sessions | Ramji Webex / Dev Webex Calendar / Dev Webex Calendar, Toruk / Namita Architecture / Srini UI Framework / Pryme calendar 4/6/15 / Pricing Manager / Pricing Uploader / Revenue Predictability and Toruk Charts / Calendar Code Deep Dive / Inventory Deep Dive / Analytics aka Yam+ Demand Summary / Backyard Roles / |
| Pryme Code | Calendar / Inventory API / Common-DB / Revenue Backend - Toruk / Pricing Nextgen Pricing , Uploader , Analytics / |
| Dimensions | |
|---|---|
| Dim | DIM_AD_DELIVERY_MODE / DIM_ AD_POSITION HOURLY , DAILY / DIM_ADVERTISER_ORDER_LINE / DIM_COUNTRY / DIM_CURRENCY / DIM_CUSTOM_SECTION / DIM_CUSTOM_SEGMENT / HIER_DIM_DEVICE APT , CB , RMX / DIM_MAP_RM_PUBLISHER_X_PROPERTY / DIM_MAP_BOOK_CNTR_FUNC_CRNC / DIM_PROPERTY / DIM_DAILY_SPACE_ID_X_PROPERTY_ID / DIM_STATE / FACT_CRNX_X_CRNC_CORP_RATE / DIM_OPERATING_SYSTEM / DIM_YAN_AD_NETWORK / |
| O2G | o2g.py / O2G yaml files / Daily Dim File / Hourly Dim File / |
| Misc | LOAD_FACT_REVENUE_MON / |
| Ymeta | Ymeta home / Ymeta / |
| Yo Metrics | Yo Metrics / |
| Space Id | Hotlist Wizard / Page Stamping Steps / ULT, YLT FAQ / Hotlist API / Page Stamping / |
| APT Entities | Networks , Publishers , Sites / |
| Metrics | DYC / Digits / Digits 2.0 / Digits Doc / Traffic / Insights / Everything Data / Stats Lite / |
| Old Digits/DYC | Segmentation / Property Report / Spaceid Inflow-Outflow / Property Inflow Outflow / Geographica / |
| Ad Technology | Ad Client / Beaconing / Beacon parser for FF / Useful Videos / |
| AIC | Classifications / AIC Presentation / AIC to SpaceId / |
| FETL | ABF Main / Schema | Session Feed Main / Schema | ABS Main / |
| Targeting | Geo Targeting Main / Architecture |
| Geo API |
Yahoo Boss Geo /
Geo Technologies Twiki /
WoeID Info /
EWS Woe List /
Geo Planet Guide /
Geo Query /
Geo Planet API /
Geo Twiki /
Find Location -
Demo to get values /
Place Finder /
WhereHouse / WhereHouse 2.0 / Dist link / Dist WhereHouse Example - http://where.yahooapis.com/v1/place/2507854?appid=mNnUFgrV34EZtU.WcBvFZbZGqgdSQG3JncAbpfH2y5FzQrmO7vnYdJzCnGWjvqHK07RNjx_0 / Zipcode loopup / Geo on Grid (Good Example) / |
| Dev Essentials | Key keeper - Get your SSH keys here / |
| Software Engineering | Agile Home , Learning , Training Material / Engineering Standards Group / Tech Stack / |
| Operations | Unix Troubleshooting Request Form / |
| Hadoop | Support Shop / Access Req (Alt) / Capacity Calculator / Cross Colo Copying / Hadoop 0.23 to 2.x compatibility / Clusters / Hadoop Dev Sandbox / Getting Started with Grid / Grid Cookbook / YDN Hadoop Tutorial / Cookbook / Hive on Zanium Tan / Request Access / |
| Grid Versions / HDFS Command Line / HDFS from Java / HDFS YCA / YZip Guide / | |
| Grid Main / Security / KInit / Hadoop Util / Good how Tos / GDM Copy / | |
| Install and Operation | Hadoop Karma / Steps to install 0.23 / Horton Install 1.3 , 2.0 PDF , 2.0 HTML / Install help on Windows / |
| Hadoop-Pig | Pig Twiki / Video Pig / UDF Guide (good) / Pig Latin Ref / Piggybank / JavaDoc for Pig functions / |
| Hive | Tips / Zanium Tan Hive / Getting Started at Yahoo / Language Manual / |
| Hbase | Getting Started At Yahoo / |
| Hadoop Misc | Good examples / Hadoop Java API / |
| Shark/Spark | Good documentation with videos / |
| Development | Developer Central / Developer Resources / Code Review Manager / Code Search Page / Yahoo Development / Arrow Framework / Starting Development / yVM Guide / yroot Guide / Maven training / |
| Yinst: Yinst / | |
| Igor: Igor / Yahoo Roles Service / | |
| CI/CD: The Factory Book / Yahoo CI / CI Pipeline / | |
| Open Stack Main , Instance , FAQ , Openstack.org , VNC on Openstack / | |
| Security | YKeyKey / YCA / Ysecure (Keydb) / |
| Language-C++ | Devel.corp / C/C++ Twiki / Tech Learn C++ / Yahoo C++ Style Guide / Tech Talk / Some good links / |
| Hack | Hack Ideas / |
| Testing | Test Manager Main , Getting Started / |
| Linux | Set up RHEL / Red hat tips / |
| Misc | Start Jboss/Tomcat / Find Port Number / Capacity Planning / BDD - Cucumber Book , BEE - Rspec Book / |
| Java | Java At Y! | Y Struts Main , Intro | |
| YUI | YUI 3 |
| ACE Framework | Documentation / Some form field documentation / Tag libs / Form management / Page Layout / Reference App / Another Reference App / Training Main , Learn , Practice , Master / Set up Java App ACE Framework UI / |
| Mobile | Yahoo Mobile Team page / iOS developer license page / |
|---|---|
| Misc | Summly Twiki , Ram Madhuram's code / |
Awk to parse a 001 delimited file and output certain fields
awk -F"\001" '{print $1, $2, $3, $4;}'
Run with param file
Edit PigRunner.py and comment out the call 'os.remove(paramFile)' in its run method.
Then run the job once using the runner.
Param file will be generated in the lib directory.
From Lib directory run
runpig -m ../lib/param_TRAF_DAY_A20_CB_20131204_C2_6545.txt ../scripts/uad/feed/cb/TRAF_DAY_A20_CB.pig
Runpig is the alias
alias runpig='pig -Dmapred.job.queue.name=apg_devmedium_p2 -Dmapreduce.job.acl-view-job=*'
git status # On branch 276_grid # Changes not staged for commit: # (use "git add..." to update what will be committed) # (use "git checkout -- ..." to discard changes in working directory) # # modified: uad/dim/udd_dim/etl_advertiser_order_line.pig # modified: uad/feed/yamp/TRAF_DAY_A20_YAMP.pig # # Untracked files: # (use "git add ..." to include in what will be committed) # # .project no changes added to commit (use "git add" and/or "git commit -a") git add uad/dim/udd_dim/etl_advertiser_order_line.pig git add uad/feed/yamp/TRAF_DAY_A20_YAMP.pig git status # On branch 276_grid # Changes to be committed: # (use "git reset HEAD ..." to unstage) # # modified: uad/dim/udd_dim/etl_advertiser_order_line.pig # modified: uad/feed/yamp/TRAF_DAY_A20_YAMP.pig # # Untracked files: # (use "git add ..." to include in what will be committed) # # .project git commit -m "[ADUAD-749] Added code to look up adv order line using ext line id." [276_grid 43a6612] [ADUAD-749] Added code to look up adv order line using ext line id. 2 files changed, 211 insertions(+), 39 deletions(-) git pull remote: Counting objects: 142, done. remote: Compressing objects: 100% (140/140), done. remote: Total 142 (delta 82), reused 0 (delta 0) Receiving objects: 100% (142/142), 63.06 KiB, done. Resolving deltas: 100% (82/82), done. From git.corp.yahoo.com:uad/uadgrid 54320d1..2eb8296 276_grid -> origin/276_grid d918d1f..b145ebf pkg_grid_276 -> origin/pkg_grid_276 * [new branch] pkg_grid_276_siji_ADUAD-697 -> origin/pkg_grid_276_siji_ADUAD-697 Merge made by the 'recursive' strategy. uad-runner/bin/refresh_data.sh | 19 +++++++++++++++---- uad-runner/conf/TRAF_DAY_A20_CB_NOADS.conf | 1 + uad-runner/conf/regression_job_names_CB.conf | 4 ++-- uad-runner/lib/localRegressionRuns.py | 57 +++++++++++++++++++++++++++++++++++++++++++++++++++++---- uad-runner/schema/REVN_TRAF_MON_A40_APT-ASIA.schema | 30 +++++++++++++++--------------- uad-runner/schema/REVN_TRAF_MON_A40_APT-AUNZ.schema | 30 +++++++++++++++--------------- uad-runner/schema/REVN_TRAF_MON_A40_APT-EMEA.schema | 30 +++++++++++++++--------------- uad-runner/schema/REVN_TRAF_MON_A40_APT.schema | 30 +++++++++++++++--------------- uad-runner/schema/REVN_TRAF_MON_A40_CB.schema | 30 +++++++++++++++--------------- uad-runner/schema/REVN_TRAF_MON_A40_RMX.schema | 30 +++++++++++++++--------------- uad-runner/schema/REVN_TRAF_MON_A40_YAMP.schema | 30 +++++++++++++++--------------- uad-runner/schema/REVN_TRAF_MON_A40_YAXR.schema | 30 +++++++++++++++--------------- uad/feed/common_fact/LOAD_TRAF_MON_A40.pig | 18 +----------------- uad/feed/yamp/LOAD_TRAF_MON_A20_YAMP.pig | 2 +- uad/feed/yamp/REVN_TRAF_DAY_A40_YAMP.pig | 14 +++++++++----- uad/feed/yamp/REVN_TRAF_MON_YAMP_A40.pig | 83 +++++++++++++++++++++++++++++++++++++++++------------------------------------------ uad/feed/yamp/TRAF_MON_A20_YAMP.pig | 2 +- uad/unitTest/DataPuller.pig | 14 ++++++++++---- 18 files changed, 254 insertions(+), 200 deletions(-) git push Counting objects: 26, done. Delta compression using up to 8 threads. Compressing objects: 100% (14/14), done. Writing objects: 100% (14/14), 3.36 KiB, done. Total 14 (delta 12), reused 0 (delta 0) To git@git.corp.yahoo.com:uad/uadgrid.git 2eb8296..d5d17c9 276_grid -> 276_grid git log --pretty=format:'%h %an %ad "%s"' --date=short -n 3 d5d17c9 Rahul Vadodkar 2015-04-02 "Merge branch '276_grid' of git.corp.yahoo.com:uad/uadgrid into 276_grid" 43a6612 Rahul Vadodkar 2015-04-02 "[ADUAD-749] Added code to look up adv order line using ext line id." 2eb8296 Devaki 2015-04-01 "Merge branch '276_grid' of ssh://git@git.corp.yahoo.com/uad/uadgrid.git into 276_grid" NOTE: Checked with Raghav, we need to cherry pick the sha which has the change. Here it is 43a6612, not d5d17c9. git checkout pkg_grid_276 Branch pkg_grid_276 set up to track remote branch pkg_grid_276 from origin. Switched to a new branch 'pkg_grid_276' git checkout -b pkg_grid_276_vadodkar_ADUAD749 Switched to a new branch 'pkg_grid_276_vadodkar_ADUAD749' findpaper-lm:uadgrid vadodkar$ git status # On branch pkg_grid_276_vadodkar_ADUAD749 # Untracked files: # (use "git add ..." to include in what will be committed) # # .project nothing added to commit but untracked files present (use "git add" to track) git cherry-pick 43a6612 [pkg_grid_276_vadodkar_ADUAD749 dacdc5f] [ADUAD-749] Added code to look up adv order line using ext line id. 2 files changed, 211 insertions(+), 39 deletions(-) git push origin pkg_grid_276_vadodkar_ADUAD749 Counting objects: 17, done. Delta compression using up to 8 threads. Compressing objects: 100% (9/9), done. Writing objects: 100% (9/9), 2.88 KiB, done. Total 9 (delta 8), reused 0 (delta 0) To git@git.corp.yahoo.com:uad/uadgrid.git * [new branch] pkg_grid_276_vadodkar_ADUAD749 -> pkg_grid_276_vadodkar_ADUAD749 Go to https://git.corp.yahoo.com/uad/uadgrid/tree/pkg_grid_276_vadodkar_ADUAD749 Click on Compare and Pull Request green button. Clicked on Edit on top right. Chose pkg_grid_276 Added comment @chiranje can you please review the code and merge Clicked on Create Pull Request green button Go to https://git.corp.yahoo.com/uad/uadgrid/tree/pkg_grid_276_vadodkar_ADUAD749.
Data Locations
Apollo Prod - PT - /projects/apollo/adv_source/daily/data
APT 15 Min Prod - PT - /projects/jaguar/prod/feeds/ir_yan_perf/15m/
CB Dev Traf - PT - /projects/uadgetlp/vadodkar/cb/mx3_uad_traffic/15m/data
CB Prod Traf - PT - /projects/uadgetlp/feeds/curveball/mx3_uad_traffic/15m/data
CB Prod Rev - PT - /projects/uadgetlp/feeds/curveball/mx3_uad_mth/hourly/data
CB Dim Dev - TT /projects/cow_ci/complete_snapshot
CB Dim Dev - TT /projects/cow_ci/incremental_snapshot
CB Dim Prod - DR /projects/cow_prod/complete_snapshot
CB Dim Prod - DR /projects/cow_prod/incremental_snapshot
RMX Prod - PT - /data/rmx/prod/ngd_cdf/30m/data
RMX Prod Late - PT - /data/rmx/prod/ngd_cdf_late/30m/data
RMX Prod Rev - PT /data/rmx/prod/rmx_uad_revenue_non/daily/data
RMX Prod Future Lines - /data/rmx/prod/rmx_uad_future_line/daily/data
YAMP /projects/kite/prod/external/invoice/uad/15m/data
PYM APT /projects/diy_prod/diy_ace/hourly/2014031623/APT_ONEPERCENT/data
Distcp info
DB to PT (run on PT)
hadoop distcp -Dmapreduce.job.acl-view-job=* -Dmapred.job.queue.name=apg_hourlyhigh_p1 -i -log ./logs/ -m 2000 webhdfs://dilithiumblue-nn1.blue.ygrid.yahoo.com/user/p_kite/uad_apt/uad/15m/data/201406120000 webhdfs://phazontan-nn1.tan.ygrid.yahoo.com/projects/uadgetlp/vadodkar/yamp/allstar
PT to MR
On MR Run
hadoop distcp -Dmapreduce.job.acl-view-job=* -Dmapred.job.queue.name=apg_devmedium_p2 -i -log ./logs/ -m 2000 webhdfs://phazontan-nn1.tan.ygrid.yahoo.com/projects/uadgetlp/job_output/TRAF_MIN_15_APT/201311040815_370590/ webhdfs://mithrilred-nn1.red.ygrid.yahoo.com/projects/uad_getl/vadodkar/basemetrics/apt15/
Copy Hourly Dims. Run following on MR.
hadoop distcp -Dmapreduce.job.acl-view-job=* -Dmapred.job.queue.name=apg_devmedium_p2 -i -log ./logs/ -m 2000 webhdfs://phazontan-nn1.tan.ygrid.yahoo.com/projects/uadgetlp/dim_job_lkup/2014051215 webhdfs://mithrilred-nn1.red.ygrid.yahoo.com/projects/uad_getl/vadodkar/dim_job_lkup
If running on PT (should not but may have to if you can't change the permissions)
hadoop distcp -Dmapreduce.job.acl-view-job=* -Dmapred.job.queue.name=apg_hourlyhigh_p1 -i -log ./logs/ -m 2000 webhdfs://phazontan-nn1.tan.ygrid.yahoo.com/projects/jaguar/prod/feeds/ir_yan_perf/15m/data/201311040815/ webhdfs://mithrilred-nn1.red.ygrid.yahoo.com/projects/uad_getl/vadodkar/basemetrics/apt15_input/data
Following change the mod so uad_getl can read. Run these as uadgetlp on Phason Tan.
hadoop fs -chmod -R 777 webhdfs://mithrilred-nn1.red.ygrid.yahoo.com/projects/uad_getl/vadodkar/basemetrics/apt15_input/data/201311040815
MR to PT
hadoop distcp -Dmapreduce.job.acl-view-job=* -Dmapred.job.queue.name=apg_devmedium_p2 -i -log ./logs/ -m 2000 hdfs://mithrilred-nn1.red.ygrid.yahoo.com:8020/projects/uad_getl/vadodkar/cb/mx3_uad_traffic/15m/data/* hdfs://phazontan-nn1.tan.ygrid.yahoo.com:8020/projects/uadgetlp/vadodkar/cb/mx3_uad_traffic/15m/data
hadoop fs -chmod -R 777 hdfs://phazontan-nn1.tan.ygrid.yahoo.com:8020/projects/uadgetlp/vadodkar/cb/mx3_uad_traffic/15m/data
MR to DR On DR
hadoop distcp -Dmapreduce.job.acl-view-job=* -Dmapred.job.queue.name=apg_hourlylow_p4 -i -log ./logs/ -m 40 webhdfs://mithrilred-nn1.red.ygrid.yahoo.com/projects/uad_getl/job_output/CB_DIM_COMPLETE/oraetl_log/CB* webhdfs://dilithiumred-nn1.red.ygrid.yahoo.com/projects/uadgetlp/vadodkar/job_output/CB_DIM_COMPLETE/oraetl_log
No need to change permission if you run the above on DR
DR to MR On DR
hadoop distcp -Dmapreduce.job.acl-view-job=* -Dmapred.job.queue.name=apg_hourlylow_p4 -i -log ./logs/ -m 40 webhdfs://dilithiumred-nn1.red.ygrid.yahoo.com/projects/cow_prod/complete_snapshot/201405062000/ad/part-m-0004[2-9] webhdfs://mithrilred-nn1.red.ygrid.yahoo.com/projects/uad_getl/vadodkar/cbdim/cow_prod/complete_snapshot/201405062000/ad
hadoop fs -chmod -R 777 webhdfs://mithrilred-nn1.red.ygrid.yahoo.com/projects/uad_getl/vadodkar/cbdim/cow_prod/complete_snapshot/201405062000/ad
DR to PT On DR
hadoop distcp -Dmapreduce.job.acl-view-job=* -Dmapred.job.queue.name=apg_hourlylow_p4 -i -log ./logs/ -m 40 webhdfs://dilithiumred-nn1.red.ygrid.yahoo.com/projects/uadgetlp/dim_job_lkup/uad_daily_dim/HIER_DIM_DEVICE_CB webhdfs://phazontan-nn1.tan.ygrid.yahoo.com/projects/uadgetlp/dim_job_lkup/uad_daily_dim
Zanium Tan to Axonite Red (Run on AR)
hadoop distcp -Dmapred.job.queue.name=unfunded -i -log ./logs/ -m 2000 webhdfs://zaniumtan-nn1.tan.ygrid.yahoo.com/user/vadodkar/rmx1pct/cdf_pig/2014052908_1055541 webhdfs://axonitered-nn1.red.ygrid.yahoo.com/user/vadodkar/pym/data/rmx
hadoop fs -chmod -R 777 hdfs://phazontan-nn1.tan.ygrid.yahoo.com:8020/projects/uadgetlp/dim_job_lkup/uad_daily_dim/HIER_DIM_DEVICE_CB
Sometimes you may have to copy prod data to PT to help SE
DB to PT - CB traf and rev - Run this on PT as uadgetlp
hadoop distcp -Dmapreduce.job.acl-view-job=* -Dmapred.job.queue.name=apg_hourlyhigh_p1 -i webhdfs://dilithiumblue-nn1.blue.ygrid.yahoo.com/projects/mx3/prod/feeds/mx3_uad_traffic/15m/data/20140423* webhdfs://phazontan-nn1.tan.ygrid.yahoo.com/projects/uadgetlp/feeds/curveball/mx3_uad_traffic/15m/data
hadoop distcp -Dmapreduce.job.acl-view-job=* -Dmapred.job.queue.name=apg_hourlyhigh_p1 -i webhdfs://dilithiumblue-nn1.blue.ygrid.yahoo.com/projects/mx3/prod/feeds/mx3_uad_mth/hourly/data/20140424* webhdfs://phazontan-nn1.tan.ygrid.yahoo.com/projects/uadgetlp/feeds/curveball/mx3_uad_mth/hourly/data
Outlook Web Access from anywhere
Now that the Exchange 2010 migrations have been completed, all Yahoos can enjoy the latest version of Outlook Web App (OWA). OWA allows you to check email on the go from a personal computer or tablet.
When you’re out of the office, you can log into OWA with no VPN connection required--just your RSA token. Simply go to https://webmail.yahoo-inc.com/owa from any computer, and select whether the computer is private or shared. The “private” option allows additional time of inactivity before automatically logging out. You’ll be able to do all the same things in OWA as you do using a desktop app, including manage folders and access shared mailboxes—but on the go
CMR Process (Raj 5/28/13)
- The SE team needs 48 hours notice to plan a CMR
- QE sign off should ideally happen before 48 hours of planned CMR.
- QE should be given heads up at least 48 hours
+ at least 2 days before sign off on any changes needing to be tested.
Ideally the Dev completion is by Tuesday of second week to give sufficient time to test and sign off on time.
The remaining part of 2nd week of sprint after Tuesday of 2nd week is to be used to testing,
bug fix and documentation, release twiki etc.
Not for enhancement or significant changes not discussed previously.
- If there is any change to be done late in the sprint – it must be discussed and mutually agreed between Dev and QE.
Igor values for Phazon Tan #COMMON.conf add yinst setting uad_grid_pkg_build.COMMON.hdfs_output_group= uad_share add yinst setting uad_grid_pkg_build.COMMON.hdfs_output_acls=750 add yinst setting uad_grid_pkg_build.COMMON.hdfs_output_base_dir=/projects/uadgetlp add yinst setting uad_grid_pkg_build.COMMON.hdfs_oracle_base_dir=/projects/uadgetlp add yinst setting uad_grid_pkg_build.COMMON.hdfs_dim_base_dir=/projects/uadgetlp add yinst setting uad_grid_pkg_build.COMMON.pig_job_queue=apg_hourlyhigh_p1 add yinst setting uad_grid_pkg_build.COMMON.PIG_D_mapred.job.queue.name=apg_hourlyhigh_p1 add yinst setting uad_grid_pkg_build.COMMON.user=uadgetlp add yinst setting uad_grid_pkg_build.COMMON.hdfs_input_dir_data= #COMMON.DEFAULT.conf add yinst setting uad_grid_pkg_build.COMMON.DEFAULT.hdfs_output_group= uad_share add yinst setting uad_grid_pkg_build.COMMON.DEFAULT.hdfs_output_acls=750 add yinst setting uad_grid_pkg_build.COMMON.DEFAULT.hdfs_output_base_dir=/projects/uadgetlp add yinst setting uad_grid_pkg_build.COMMON.DEFAULT.hdfs_oracle_base_dir=/projects/uadgetlp add yinst setting uad_grid_pkg_build.COMMON.DEFAULT.hdfs_dim_base_dir=/projects/uadgetlp add yinst setting uad_grid_pkg_build.COMMON.DEFAULT.pig_job_queue=apg_hourlyhigh_p1 add yinst setting uad_grid_pkg_build.COMMON.DEFAULT.PIG_D_mapred.job.queue.name=apg_hourlyhigh_p1 add yinst setting uad_grid_pkg_build.COMMON.DEFAULT.user=uadgetlp add yinst setting uad_grid_pkg_build.COMMON.DEFAULT.hdfs_input_dir_data= #COMMON.PT.conf add yinst setting uad_grid_pkg_build.COMMON.PT.hdfs_output_group= uad_share add yinst setting uad_grid_pkg_build.COMMON.PT.hdfs_output_acls=750 add yinst setting uad_grid_pkg_build.COMMON.PT.hdfs_output_base_dir=/projects/uadgetlp add yinst setting uad_grid_pkg_build.COMMON.PT.hdfs_oracle_base_dir=/projects/uadgetlp add yinst setting uad_grid_pkg_build.COMMON.PT.hdfs_dim_base_dir=/projects/uadgetlp add yinst setting uad_grid_pkg_build.COMMON.PT.pig_job_queue=apg_hourlyhigh_p1 add yinst setting uad_grid_pkg_build.COMMON.PT.PIG_D_mapred.job.queue.name=apg_hourlyhigh_p1 add yinst setting uad_grid_pkg_build.COMMON.PT.user=uadgetlp add yinst setting uad_grid_pkg_build.COMMON.PT.hdfs_input_dir_data= #TRAF_MIN_15_APT.DEFAULT.conf add yinst setting uad_grid_pkg_build.TRAF_MIN_15_APT.DEFAULT.hdfs_input_base_dir=/projects/jaguar/prod/feeds/ir_yan_perf/15m/ #TRAF_MIN_15_APT.PT.conf add yinst setting uad_grid_pkg_build.TRAF_MIN_15_APT.PT.hdfs_input_base_dir=webhdfs://phazontan-nn1.tan.ygrid.yahoo.com/projects/jaguar/prod/feeds/ir_yan_perf/15m/ #TRAF_MIN_15_APT.DR.conf add yinst setting uad_grid_pkg_build.TRAF_MIN_15_APT.DR.hdfs_input_base_dir=webhdfs://dilithiumred-nn1.red.ygrid.yahoo.com/projects/jaguar/prod/feeds/ir_yan_perf/15m/ #TRAF_DAY_A20_APT_COMSCORE.DEFAULT.conf add yinst setting uad_grid_pkg_build.TRAF_DAY_A20_APT_COMSCORE.DEFAULT.hdfs_input_base_dir=/projects/jaguar/prod/feeds/ir_yan_perf/15m/data/ #TRAF_DAY_A20_APT_COMSCORE.PT.conf add yinst setting uad_grid_pkg_build.TRAF_DAY_A20_APT_COMSCORE.PT.hdfs_input_base_dir=webhdfs://phazontan-nn1.tan.ygrid.yahoo.com/projects/jaguar/prod/feeds/ir_yan_perf/15m/data/ #TRAF_DAY_A20_APT_COMSCORE.DR.conf add yinst setting uad_grid_pkg_build.TRAF_DAY_A20_APT_COMSCORE.DR.hdfs_input_base_dir=webhdfs://dilithiumred-nn1.red.ygrid.yahoo.com/projects/jaguar/prod/feeds/ir_yan_perf/15m/data/ #TRAF_DAY_A20_APT_BASE.conf add yinst setting uad_grid_pkg_build.TRAF_DAY_A20_APT_BASE.hdfs_input_base_dir=/projects/uadgetlp/job_output/TRAF_MIN_15_APT #TRAF_DAY_A20_RMX.conf add yinst setting uad_grid_pkg_build.TRAF_DAY_A20_RMX.hdfs_input_dir_data=/data/rmx/prod/ngd_cdf/30m/data #TRAF_DAY_A20_RMX_LATE.conf add yinst setting uad_grid_pkg_build.TRAF_DAY_A20_RMX_LATE.hdfs_input_dir_data=/data/rmx/prod/ngd_cdf_late/30m/data #TRAF_DAY_A20_RMX_OLD.conf add yinst setting uad_grid_pkg_build.TRAF_DAY_A20_RMX_OLD.hdfs_input_dir_data=/data/rmx/prod/ngd_cdf/30m/data #TRAF_EOM_A20_RMX.conf add yinst setting uad_grid_pkg_build.TRAF_EOM_A20_RMX.hdfs_input_base_dir=/projects/uadgetlp/ #TRAF_EOM_A20_RMX_OLD.conf add yinst setting uad_grid_pkg_build.TRAF_EOM_A20_RMX_OLD.hdfs_input_base_dir=/projects/uadgetlp/ #TRAF_MON_A20_RMX.conf add yinst setting uad_grid_pkg_build.TRAF_MON_A20_RMX.hdfs_input_base_dir=/projects/uadgetlp/ #TRAF_MON_A20_APT_BASE.conf add yinst setting uad_grid_pkg_build.TRAF_MON_A20_APT_BASE.hdfs_input_base_dir=/projects/uadgetlp/job_output #TRAF_MON_A20_RMX_OLD.conf add yinst setting uad_grid_pkg_build.TRAF_MON_A20_RMX_OLD.hdfs_input_base_dir=/projects/uadgetlp/ #REV_DAY_RMX.conf add yinst setting uad_grid_pkg_build.REV_DAY_RMX.hdfs_input_base_dir=/projects/uadgetlp/feeds/rmx/rmx_uad_revenue/daily/data #REV_DAY_FL_RMX.conf add yinst setting uad_grid_pkg_build.REV_DAY_FL_RMX.hdfs_input_base_dir=/data/rmx/prod/rmx_uad_future_line/daily/data #REVN_TRAF_MON_A40_RMX.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A40_RMX.hdfs_input_dir_data=/projects/uadgetlp/job_output add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A40_RMX.job_name_input=TRAF_MON_A20_RMX #REVN_TRAF_MON_A41_RMX.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A41_RMX.job_name_input=REVN_TRAF_MON_A40_RMX add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A41_RMX.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A41_RMX_OLD.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A41_RMX_OLD.job_name_input=REVN_TRAF_MON_A40_RMX add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A41_RMX_OLD.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A45_RMX.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A45_RMX.job_name_input=REVN_TRAF_MON_A40_RMX add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A45_RMX.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A40_APT_BASE.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A40_APT_BASE.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A41_APT_BASE.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A41_APT_BASE.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A44_APT_BASE.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A44_APT_BASE.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A45_APT_BASE.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A45_APT_BASE.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A24_APT_BASE.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A24_APT_BASE.hdfs_input_dir_data=/projects/uadgetlp/job_output #REV_DAY_CB_BASE.conf add yinst setting uad_grid_pkg_build.REV_DAY_CB_BASE.hdfs_input_base_dir=/projects/uadgetlp/feeds/curveball/mx3_uad_mth/hourly/data #TRAF_DAY_A20_CB_BASE.conf add yinst setting uad_grid_pkg_build.TRAF_DAY_A20_CB_BASE.hdfs_input_base_dir=/projects/uadgetlp/feeds/curveball/mx3_uad_traffic/15m/data #TRAF_DAY_A20_YAMP.conf add yinst setting uad_grid_pkg_build.TRAF_DAY_A20_YAMP.hdfs_input_dir_data=/projects/kite/prod/external/invoice/uad/15m/data #SEARCH_ADV_SOURCE_DAY.conf add yinst setting uad_grid_pkg_build.SEARCH_ADV_SOURCE_DAY.hdfs_input_base_dir=/projects/apollo/adv_source/daily/data/ add yinst setting uad_grid_pkg_build.SEARCH_ADV_SOURCE_DAY.hdfs_dim_ycrm_account_snapshot=/projects/apollo/dim_ycrm_account_snapshot/daily/data add yinst setting uad_grid_pkg_build.SEARCH_ADV_SOURCE_DAY.hdfs_dim_mdm_customer_alt_id_snapshot=/projects/apollo/dim_mdm_customer_alt_id_snapshot/daily/data add yinst setting uad_grid_pkg_build.SEARCH_ADV_SOURCE_DAY.hdfs_dim_sfdc_account_snapshot=/projects/apollo/dim_sfdc_account_merge_snapshot/daily/data #TRAF_MIN_15_APT_BM.conf add yinst setting uad_grid_pkg_build.TRAF_MIN_15_APT_BM.hdfs_input_base_dir=/projects/jaguar/prod/feeds/base_metric/15m #CB_DIM_COMPLETE.conf add yinst setting uad_grid_pkg_build.CB_DIM_COMPLETE.hdfs_input_base_dir=/projects/cow_prod/complete_snapshot #IMS_SUPPLY_DAY_A20.conf add yinst setting uad_grid_pkg_build.IMS_SUPPLY_DAY_A20.hdfs_input_base_dir=/projects/uadgetlp/feeds/ims #NOADS_DAY_A20_APT.DEFAULT.conf add yinst setting uad_grid_pkg_build.NOADS_DAY_A20_APT.DEFAULT.hdfs_input_dir_data=/projects/jaguar/prod/feeds/ir_no_ad_yan_perf/15m/data/ #NOADS_DAY_A20_APT.PT.conf add yinst setting uad_grid_pkg_build.NOADS_DAY_A20_APT.PT.hdfs_input_dir_data=webhdfs://phazontan-nn1.tan.ygrid.yahoo.com/projects/jaguar/prod/feeds/ir_no_ad_yan_perf/15m/data/ #NOADS_DAY_A20_APT.DR.conf add yinst setting uad_grid_pkg_build.NOADS_DAY_A20_APT.DR.hdfs_input_dir_data=webhdfs://dilithiumred-nn1.red.ygrid.yahoo.com/projects/jaguar/prod/feeds/ir_no_ad_yan_perf/15m/data/ #CB_DIM_INCREMENTAL.conf add yinst setting uad_grid_pkg_build.CB_DIM_INCREMENTAL.hdfs_input_base_dir=/projects/cow_prod/incremental_snapshot/ #TRAF_MON_A20_CB_BASE.conf add yinst setting uad_grid_pkg_build.TRAF_MON_A20_CB_BASE.hdfs_input_base_dir=/projects/uadgetlp/job_output #REVN_TRAF_MON_A40_CB.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A40_CB.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A41_CB.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A41_CB.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A45_CB.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A45_CB.hdfs_input_dir_data=/projects/uadgetlp/job_output #TRAF_MON_A20_YAMP_BASE.conf add yinst setting uad_grid_pkg_build.TRAF_MON_A20_YAMP_BASE.hdfs_input_base_dir=/projects/uadgetlp/job_output #REVN_TRAF_MON_A40_YAMP.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A40_YAMP.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A41_YAMP.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A41_YAMP.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A45_YAMP.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A45_YAMP.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A20_RMX.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A20_RMX.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A20_APT_BASE.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A20_APT_BASE.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A24_CB.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A24_CB.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A44_CB.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A44_CB.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A46_CB.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A46_CB.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A24_YAMP.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A24_YAMP.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A44_YAMP.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A44_YAMP.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A46_YAMP.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A46_YAMP.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A20_CB.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A20_CB.hdfs_input_dir_data=/projects/uadgetlp/job_output #REVN_TRAF_MON_A20_YAMP.conf add yinst setting uad_grid_pkg_build.REVN_TRAF_MON_A20_YAMP.hdfs_input_dir_data=/projects/uadgetlp/job_output #DQ_TRAF_MON_APT_BASE.conf add yinst setting uad_grid_pkg_build.DQ_TRAF_MON_APT_BASE.hdfs_input_base_dir=/projects/uadgetlp/job_output #DQ_TRAF_MON_CB_BASE.conf add yinst setting uad_grid_pkg_build.DQ_TRAF_MON_CB_BASE.hdfs_input_base_dir=/projects/uadgetlp/job_output #DQ_TRAF_MON_YAMP.conf add yinst setting uad_grid_pkg_build.DQ_TRAF_MON_YAMP.hdfs_input_base_dir=/projects/uadgetlp/job_output #NOADS_MON_A20_APT.conf add yinst setting uad_grid_pkg_build.NOADS_MON_A20_APT.hdfs_input_base_dir=/projects/uadgetlp/job_output #NOADS_MON_A20_CB add yinst setting uad_grid_pkg_build.NOADS_MON_A20_CB.hdfs_input_base_dir=/projects/uadgetlp/job_output #CB_BASE_METRICS add yinst setting uad_grid_pkg_build.CB_BASE_METRICS.hdfs_input_base_dir=/projects/uadgetlp/feeds/curveball/mx3_base_metrics/15m/data/ add yinst setting uad_grid_pkg_build.CB_BASE_METRICS.hdfs_fact_dir=/projects/uadgetlp/job_output
| Email Hacks | Yahoo Mail Search Home / Search in Vespa / Flags / Mail search shortcuts / Vespa Search / |