# Written By Miranda Johnson # email mjohnson@criw.com #the disallowed agents are known email harvesters used by spammers! User-agent: Titan Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: ExtractorPro Disallow: / #allow content to search engine spiders except in the folders User-agent: * Disallow: /092004TeleFlyer_files/ Disallow: /102004TeleFlyer_files/ Disallow: /112004TeleFlyer_files/ Disallow: /360Competency/ Disallow: /about/ Disallow: /achievementtec/ Disallow: /achiever/ Disallow: /AchvrScoreSysBell_files/ Disallow: /AEDWFTest/ Disallow: /AgouraHillsCAFlyer_files/ Disallow: /aspnet_client/ Disallow: /atecdemo/ Disallow: /auto/ Disallow: /AutoHiring/ Disallow: /AutoPeople/ Disallow: /autopeople2/ Disallow: /BALFlyerDec14_files/ Disallow: /BALFlyerNov10_files/ Disallow: /benchmark/ Disallow: /BlankScoreSheet_files/ Disallow: /BrinksStatus/ Disallow: /cadvisor/ Disallow: /career/ Disallow: /careerat/ Disallow: /careerav/ Disallow: /careercw/ Disallow: /careerics/ Disallow: /careernc/ Disallow: /careeron/ Disallow: /careerrh/ Disallow: /careerx/ Disallow: /Cicistesting/ Disallow: /CollegeCareerAdvisor/ Disallow: /Comp/ Disallow: /Comp1/ Disallow: /Comp2/ Disallow: /Company/ Disallow: /Competency/ Disallow: /Consultant/ Disallow: /Consultantx/ Disallow: /Consultanty/ Disallow: /Copy of Training/ Disallow: /criold/ Disallow: /CRIW.com_old-6-25-04/ Disallow: /criwhiringDemo/ Disallow: /CriwTab/ Disallow: /cskq/ Disallow: /DatabasesForDemoSites/ Disallow: /DependabilityScoreSheet_files/ Disallow: /diversity/ Disallow: /DiversityDemo/ Disallow: /EC/ Disallow: /ecData/ Disallow: /ecDBDetails/ Disallow: /ecDBDetailsBkUp/ Disallow: /ecDBDetailsSave/ Disallow: /ecdemo/ Disallow: /ecsites/ Disallow: /es/ Disallow: /eskq/ Disallow: /esold/ Disallow: /Evaluator/ Disallow: /EvaluatorDEC30_2003/ Disallow: /EvansFlyerDec7_files/ Disallow: /ExitInterview/ Disallow: /FastScreen/ Disallow: /FinJob/ Disallow: /Flash/ Disallow: /FoothillRanchCA_files/ Disallow: /FridayTraining/ Disallow: /fskq/ Disallow: /hiringsites/ Disallow: /hrstudents/ Disallow: /III_files/ Disallow: /II_files/ Disallow: /images/ Disallow: /Includes/ Disallow: /info/ Disallow: /InfoSites/ Disallow: /IPR/ Disallow: /IV_files/ Disallow: /I_files/ Disallow: /job/ Disallow: /JobClub/ Disallow: /JobFitScoreSheet_files/ Disallow: /Lance/ Disallow: /Learn/ Disallow: /learning/ Disallow: /lkq/ Disallow: /Logos/ Disallow: /MHCompetency/ Disallow: /MHS59/ Disallow: /MiltCotter/ Disallow: /MJTest/ Disallow: /NewSite/ Disallow: /NYCBloodCenter/ Disallow: /ohmart/ Disallow: /OKFlyerJan20-2005_files/ Disallow: /onearmy/ Disallow: /PA/ Disallow: /PDC/ Disallow: /PDP/ Disallow: /PhoenixFlyerNov30_files/ Disallow: /PMCompany/ Disallow: /pp/ Disallow: /prachiever/ Disallow: /presentations/ Disallow: /Projects/ Disallow: /ProjectsOld/ Disallow: /prospects/ Disallow: /prospectsfinal-bkup/ Disallow: /prospectsold-model1/ Disallow: /ps/ Disallow: /pskq/ Disallow: /Samples/ Disallow: /ScoreSheetWithPattern_files/ Disallow: /sexualharassment/ Disallow: /SHDemo/ Disallow: /Sites/ Disallow: /sixsigma/ Disallow: /skq/ Disallow: /social/ Disallow: /SSwithBellCurve/ Disallow: /STTLFlyerNov16-1_files/ Disallow: /STTLFlyerNov16_files/ Disallow: /techsupport/ Disallow: /TempAgency/ Disallow: /TempAgency2/ Disallow: /The-Achiever/ Disallow: /theanswer/ Disallow: /TimeClock/ Disallow: /Timesheet/ Disallow: /Training/ Disallow: /UnderstandingAchiever_files/ Disallow: /verbage/ Disallow: /VHRCNew/ Disallow: /WebDrive/ Disallow: /_EmailGraphics/ Disallow: /_mmServerScripts/