Create an Account
username: password:
 
  MemeStreams Logo

blog dds: 2009.03.04 - Parallelizing Jobs with xargs

search

Lost
Picture of Lost
My Blog
My Profile
My Audience
My Sources
Send Me a Message

sponsored links

Lost's topics
Arts
Business
Games
Health and Wellness
Home and Garden
Miscellaneous
Current Events
Recreation
Local Information
Science
Society
Sports
Technology

support us

Get MemeStreams Stuff!


 
blog dds: 2009.03.04 - Parallelizing Jobs with xargs
Topic: Technology 3:58 am EDT, Mar 13, 2009

The xargs -P flag can also be useful for parellelizing commands that depend on a large number of high-latency systems. Only a week ago I spent hours to write a script that would resolve IP addresses into host names in parallel. (Yes, I know the logresolve.pl that comes with the Apache web server distribution, and the speedup it provides leaves a lot to be desired.) Had I known the -P xargs option, I would have finished my task in minutes.

blog dds: 2009.03.04 - Parallelizing Jobs with xargs



 
 
Powered By Industrial Memetics
RSS2.0