Extract data between epoch times in a csv using shell script -

-

i'm trying work on following sample data:

amanda,1.00,1418691511,non-technical,v1 charles,7.05,1417093994,technical,v1 christopher,7.00,1417102400,technical,v2 david,4.00,1417093447,non-technical,v1 john,4.75,1417059582,technical,v1 john,7.80,1417102602,technical,v2 joseph,7.80,1417093804,technical,v1 joseph,5.00,1423504662,technical,v2 michael,7.55,1417092924,technical,v1 richard,5.00,1417093649,non-technical,v1 robert,3.00,1417092640,non-technical,v1 thomas,6.75,1417102170,technical,v1 william,4.50,1417093255,non-technical,v1 rd,2.00,1426017161,technical,v8 rd,2.75,1426449217,technical,v9

here third column in csv epoch date format timestamp of individual records.

i want extract data has time stamp between today , past 3 days only.

following used achieve doesn't seem working me.

awk -f , '{if ($3 >= system("date +%s --date="3 days ago"") && $3 <= system("date +%s")) { print }}'

can me in understanding went wrong here?

the double quotes in command not work want them to:

awk -f , '{if ($3 >= system("date +%s --date="3 days ago"") && $3 <= system("date +%s")) { print }}'                                              ^          ^

the 2 marked ones cause trouble.

i'd use:

awk -f, -v old=$(date +%s --date="3 days ago") -v new=$(date +s) \     '{ if ($3 >= old && $3 <= new) print }'

or even:

awk -f, -v old=$(date +%s --date="3 days ago") -v new=$(date +s) \     '$3 >= old && $3 <= new'

there times when system necessary, try treat 'bad smell'. usually, not necessary if think carefully.


Comments

Post a Comment

Popular posts from this blog

node.js - Mongoose: Cast to ObjectId failed for value on newly created object after setting the value -

-
this question has answer here: what's mongoose error cast objectid failed value xxx @ path “_id”? 7 answers even though has been asked many times because entity has no valid objectid field. i came across situation objectid set value can casted objectid still error. the schema: var serviceschema = parammongoose.schema({ servicename:{ type: parammongoose.schema.types.objectid , ref: 'servicenames',required:true } }); pseudo code: servicefromdb=new service({servicename:'some name'}); servicefromdb.servicename='000000000000000000000001'; servicefromdb.save(function(paramerror,paramdata){ if(paramerror){ console.log('but but...',servicefromdb,paramerror) } }); the output of code is: but but... { servicename: 000000000000000000000001, _id: 55079a90286f49280364f78b } { [casterror: cast objectid faile...
Read more

gradle error "Cannot convert the provided notation to a File or URI" -

-
i have defined 2 system properties in gradle.properties: systemprop.builddir=build systemprop.cfgdir=build\\cfg and have following task defined in build.gradle: task clean(group:'clean',description:'clean project') << { ant.sequential { delete(dir: system.properties.builddir) mkdir(dir: system.properties.builddir) delete(dir: system.properties.cfgdir) mkdir(dir: system.properties.cfgdir) } } this generates following error: execution failed task ':clean'. > cannot convert provided notation file or uri: {dir=build}. following types/formats supported: - string or charsequence path, e.g 'src/main/java' or '/usr/include' - string or charsequence uri, e.g 'file:/usr/include' - file instance. - uri or url instance. but equivalent block of code not generate error , works expected: task clean(group:'clean',description:'clean project') << { ...
Read more

python - NameError: name 'subprocess' is not defined -

-
i'm trying make rng website: http://jamesdotcom.com/?p=417 . when run following code: captureimage = subprocess.popen( [ "fswebcam", "-r", "356x292", "-d", "/dev/video0", "static.jpg", "--skip", "10" ], stdout=devnull, stderr=devnull) captureimage.communicate() i following error message: nameerror: name 'subprocess' not defined what should do? thanks have imported first? import subprocess captureimage = subprocess.popen(["fswebcam", ...) subprocess included in python standard library since python 2.4. should not necessary install it.
Read more