i have news aggregator website and have many sources need sometime to update in one minute maybe 7 new posts i make more cron jobs in cpanel every minute,every two minutes,5minutes but problem is duplicate posts how to resolve this can anyone help me with some shell script? thanks in advance!