Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question?
If it is not in the man pages or the how-to's this is the place! |
Notices |
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
Are you new to LinuxQuestions.org? Visit the following links:
Site Howto |
Site FAQ |
Sitemap |
Register Now
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
Get a virtual cloud desktop with the Linux distro that you want in less than five minutes with Shells! With over 10 pre-installed distros to choose from, the worry-free installation life is here! Whether you are a digital nomad or just looking for flexibility, Shells can put your Linux machine on the device that you want to use.
Exclusive for LQ members, get up to 45% off per month. Click here for more info.
|
 |
|
06-15-2017, 07:23 AM
|
#16
|
LQ Guru
Registered: Apr 2010
Location: Continental USA
Distribution: Debian, Ubuntu, RedHat, DSL, Puppy, CentOS, Knoppix, Mint-DE, Sparky, VSIDO, tinycore, Q4OS, Manjaro
Posts: 6,173
|
Quote:
Originally Posted by Turbocapitalist
I'd say wpeckham's advice about figuring out the workflow is important. But unfortunately that workflow is somewhat dependent on the tool(s) used. Thus you have a bit of a circular dependency. To break that, I'd nudge you in the direction of awk or perl, mainly the former. I see a way to do it with two instructions with awk -- if the date field is always first in each block.
Regardless of which tools you start with, please post what you have begun so we can see the direction you are taking and can offer advice.
|
The concepts of planning I offered do not derive from the workflow, indeed may help DETERMINE the workflow. They depend upon analysis of the DATA flow as derived from the statement of the problem, data input, desired transformations, and data output, and not at all on the tools used. There is no circular dependency. I see why you think there may be, but you if you consider it as a programming problem there is none.
BASH can do this, PERL is almost DESIGNED to do this (and most things, it is one of the most versatile tools), or you can do this in python, Pascal, c, assembler, BASIC, FORTRAN, COBOL ... : the list is almost endless.
The OP needs to consider what he WANTS to use (BASH is an expressed preference, see the title of the thread) so we can assume that over awk, perl, sed, etc.
Bash can, using only internal commands and shell features, read files, compare and use strings, create files and folders, all of the critical pieces are there for this problem without calling awk, sed, grep, perl, or other external tools. He may, on consieration, wish to use one or more external tools as a 'helper' for his script, but it can be done without those.
.
Last edited by wpeckham; 06-15-2017 at 07:25 AM.
|
|
|
06-15-2017, 09:53 AM
|
#17
|
LQ Guru
Registered: May 2005
Location: boston, usa
Distribution: fedora-35
Posts: 5,326
|
i think by circular dependence he meant that it would be hard to draw a diagram without knowing the feature set of awk, for example ?
|
|
|
06-15-2017, 10:50 AM
|
#18
|
LQ Guru
Registered: Apr 2010
Location: Continental USA
Distribution: Debian, Ubuntu, RedHat, DSL, Puppy, CentOS, Knoppix, Mint-DE, Sparky, VSIDO, tinycore, Q4OS, Manjaro
Posts: 6,173
|
Quote:
Originally Posted by schneidz
i think by circular dependence he meant that it would be hard to draw a diagram without knowing the feature set of awk, for example ?
|
That makes sense. But it starts by assuming that you will first look at your tools to decide what you want to do. That seems backwards. First define properly what you want to do THEN look at your tools and find the right ones.
Both plans are partly out of line here. The question was how to do it in BASH, so awk, sed, etc. are off the table. Properly defining what you want to do is still valid.
I am looking forward to seeing what the first cut looks like. There are so many good ways to approach this.
Last edited by wpeckham; 06-15-2017 at 10:51 AM.
|
|
|
06-15-2017, 11:12 AM
|
#19
|
LQ Guru
Registered: Apr 2005
Distribution: Linux Mint, Devuan, OpenBSD
Posts: 7,746
|
Quote:
Originally Posted by schneidz
i think by circular dependence he meant that it would be hard to draw a diagram without knowing the feature set of awk, for example ?
|
Yeah. That's about it. Also since this is a newbie subforum, the word "bash" often ends up meaning "anything except GUI" Hence the pointer to awk and Perl
|
|
|
06-16-2017, 06:06 AM
|
#20
|
LQ Newbie
Registered: Jun 2017
Posts: 6
Original Poster
Rep: 
|
I needed it using awk, did not know it wasn't a part of bash. Below code worked as per need.
Thanks all.
awk -F' ' '{fn=$1".log";print>fn;close(fn)}' \FS='\n' OFS='\n' RS='---+\n' ORS='' filename
|
|
|
06-16-2017, 06:16 AM
|
#21
|
LQ Guru
Registered: Apr 2005
Distribution: Linux Mint, Devuan, OpenBSD
Posts: 7,746
|
Great. You could even trim the file names to just the date using sub()
Code:
awk -F' ' '{fn=$1".log";sub(/^.* /,"",fn);print>fn;close(fn)}' \FS='\n' OFS='\n' RS='---+\n' ORS='' filename
See "man awk" for the full manual.
awk is acessible via bash but not part of it. bash is just one of the interfaces to the system. You have bash, zsh, ksh, and dash on the one hand for text. On the other hand for graphics, you have Unity, XFCE, KDE, LXDE, and Openbox, just to name a few from either category.
|
|
|
06-16-2017, 10:31 PM
|
#22
|
LQ Newbie
Registered: Jun 2017
Posts: 6
Original Poster
Rep: 
|
Thanks. But, i am looking for the file format to be <filename_YYYYMMDD.log>. Can anybody help on this please?
|
|
|
06-16-2017, 10:47 PM
|
#23
|
LQ Guru
Registered: Apr 2005
Distribution: Linux Mint, Devuan, OpenBSD
Posts: 7,746
|
Yes, check "man awk" for info on sub(), gsub(), match(), or substr() to see how far you can get with rearranging the existing numbers. Probably the latter two are most relevant. Maybe do not append the '.log' part to fn until you've got the first part of the file name settled.
As things get more complex, the problem becomes more appropriate for perl. But it should be doable within awk still.
|
|
|
06-17-2017, 12:09 PM
|
#24
|
Senior Member
Registered: Feb 2003
Distribution: debian
Posts: 4,137
|
Bash has length and string parts manipulation built in.
$ MYDATE="01-01-1970"; echo "MYDATE contains "$MYDATE" and has "${#MYDATE}" characters."; echo "YYYY="${MYDATE:6:4}" MM="${MYDATE:3:2}" DD="${MYDATE:0:2};
|
|
|
06-17-2017, 12:14 PM
|
#25
|
Senior Member
Registered: Feb 2003
Distribution: debian
Posts: 4,137
|
Note to self, buy less tea. In that example the offsets assume a DD-MM-YYYY format. Apparently I woke up british or something this morning.
|
|
|
06-17-2017, 12:29 PM
|
#26
|
LQ Guru
Registered: Sep 2013
Location: Somewhere in my head.
Distribution: Slackware (15 current), Slack15, Ubuntu studio, MX Linux, FreeBSD 13.1, WIn10
Posts: 10,342
|
Quote:
Originally Posted by rashmi88
Thanks. But, i am looking for the file format to be <filename_YYYYMMDD.log>. Can anybody help on this please?
|
if you know the pattern is going to be a filename[underscore]Numbers indicating a date. then why not search for the underscore then chop it off giving you the date to do with what you will?
or are you saying something else
http://www.theunixschool.com/2012/06...file-into.html
Last edited by BW-userx; 06-17-2017 at 02:01 PM.
|
|
|
06-17-2017, 11:29 PM
|
#27
|
LQ Guru
Registered: May 2005
Location: boston, usa
Distribution: fedora-35
Posts: 5,326
|
Quote:
Originally Posted by rashmi88
Thanks. But, i am looking for the file format to be <filename_YYYYMMDD.log>. Can anybody help on this please?
|
|
|
|
06-18-2017, 10:32 AM
|
#28
|
LQ Guru
Registered: Apr 2010
Location: Continental USA
Distribution: Debian, Ubuntu, RedHat, DSL, Puppy, CentOS, Knoppix, Mint-DE, Sparky, VSIDO, tinycore, Q4OS, Manjaro
Posts: 6,173
|
Quote:
Originally Posted by schneidz
|
OK, that is not the file format, the is the file NAME format. That is easy enough to put together in BASH, it should be doable easily in AWK (or a combination) but I do not AWK enough to say how.
|
|
|
06-18-2017, 01:37 PM
|
#29
|
LQ Guru
Registered: Sep 2013
Location: Somewhere in my head.
Distribution: Slackware (15 current), Slack15, Ubuntu studio, MX Linux, FreeBSD 13.1, WIn10
Posts: 10,342
|
if you can use bash script then I got a solution for ya. but if it got a be awk then I'm out too, I do not use that.
|
|
|
All times are GMT -5. The time now is 01:07 AM.
|
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.
|
Latest Threads
LQ News
|
|