Removing files under particular conditions (number of files, file age)
I want to create a shell script that will count files (1 hr older files) and if files are more than 1000, then delete all.
For read and delete I am using those command at putty
for count:
ls /tmp/ | grep 'ci_session*' | wc -l
for Delete files:
cd /tmp/
find . -name "ci_session*" -exec rm {} ;
#Update: for delete, i want to delete only 1 hr older files.
Here I want to add condition if total files are greater than 1000, then call delete command.
linux bash find
New contributor
add a comment |
I want to create a shell script that will count files (1 hr older files) and if files are more than 1000, then delete all.
For read and delete I am using those command at putty
for count:
ls /tmp/ | grep 'ci_session*' | wc -l
for Delete files:
cd /tmp/
find . -name "ci_session*" -exec rm {} ;
#Update: for delete, i want to delete only 1 hr older files.
Here I want to add condition if total files are greater than 1000, then call delete command.
linux bash find
New contributor
1
Why not parsels
?
– Cyrus
2 days ago
Greater than 1000 what? Lines long? Bytes? Or are you wanting to delete only if there are more than 1000 files?
– Kusalananda
2 days ago
Are you okay with "Older than 1 hour" meaning last modified greater than 1 hour ago? Unix operating systems generally don't have a concept of creation time
– Jesse_b
2 days ago
@Kusalananda number of files.
– Yogesh Saroya
2 days ago
add a comment |
I want to create a shell script that will count files (1 hr older files) and if files are more than 1000, then delete all.
For read and delete I am using those command at putty
for count:
ls /tmp/ | grep 'ci_session*' | wc -l
for Delete files:
cd /tmp/
find . -name "ci_session*" -exec rm {} ;
#Update: for delete, i want to delete only 1 hr older files.
Here I want to add condition if total files are greater than 1000, then call delete command.
linux bash find
New contributor
I want to create a shell script that will count files (1 hr older files) and if files are more than 1000, then delete all.
For read and delete I am using those command at putty
for count:
ls /tmp/ | grep 'ci_session*' | wc -l
for Delete files:
cd /tmp/
find . -name "ci_session*" -exec rm {} ;
#Update: for delete, i want to delete only 1 hr older files.
Here I want to add condition if total files are greater than 1000, then call delete command.
linux bash find
linux bash find
New contributor
New contributor
edited 2 days ago
Kusalananda
137k17258426
137k17258426
New contributor
asked 2 days ago
Yogesh SaroyaYogesh Saroya
1265
1265
New contributor
New contributor
1
Why not parsels
?
– Cyrus
2 days ago
Greater than 1000 what? Lines long? Bytes? Or are you wanting to delete only if there are more than 1000 files?
– Kusalananda
2 days ago
Are you okay with "Older than 1 hour" meaning last modified greater than 1 hour ago? Unix operating systems generally don't have a concept of creation time
– Jesse_b
2 days ago
@Kusalananda number of files.
– Yogesh Saroya
2 days ago
add a comment |
1
Why not parsels
?
– Cyrus
2 days ago
Greater than 1000 what? Lines long? Bytes? Or are you wanting to delete only if there are more than 1000 files?
– Kusalananda
2 days ago
Are you okay with "Older than 1 hour" meaning last modified greater than 1 hour ago? Unix operating systems generally don't have a concept of creation time
– Jesse_b
2 days ago
@Kusalananda number of files.
– Yogesh Saroya
2 days ago
1
1
Why not parse
ls
?– Cyrus
2 days ago
Why not parse
ls
?– Cyrus
2 days ago
Greater than 1000 what? Lines long? Bytes? Or are you wanting to delete only if there are more than 1000 files?
– Kusalananda
2 days ago
Greater than 1000 what? Lines long? Bytes? Or are you wanting to delete only if there are more than 1000 files?
– Kusalananda
2 days ago
Are you okay with "Older than 1 hour" meaning last modified greater than 1 hour ago? Unix operating systems generally don't have a concept of creation time
– Jesse_b
2 days ago
Are you okay with "Older than 1 hour" meaning last modified greater than 1 hour ago? Unix operating systems generally don't have a concept of creation time
– Jesse_b
2 days ago
@Kusalananda number of files.
– Yogesh Saroya
2 days ago
@Kusalananda number of files.
– Yogesh Saroya
2 days ago
add a comment |
2 Answers
2
active
oldest
votes
I interpreted your question as "How may I count the files, and if there are more than 1000, delete the ones that are older than one hour?".
Counting the names matching /tmp/ci_session*
and doing something when there's more than 1000 of them:
set -- /tmp/ci_session*
if [ "$#" -gt 1000 ]; then
# something
fi
This sets the positional parameters to the names matching the pattern. The special variable $#
then contains the number of positional parameters.
Deleting the files matching /tmp/ci_session*
if their last modified time is more than an hour ago:
find /tmp -maxdepth 1 -type f -name 'ci_session*' -mmin +60 -delete
Taken together:
#!/bin/sh
set -- /tmp/ci_session*
if [ "$#" -gt 1000 ]; then
find /tmp -maxdepth 1 -type f -name 'ci_session*' -mmin +60 -delete
fi
The only thing to note here is that the count will be of any name matching the pattern (even of directory names, if there are any), while the find
command will restrict the deletion to only regular files (i.e. not directories).
I thoughtset
would surely fail with "argument list too long" at some point, but no. I guess becauseset
is a built-in?
– l0b0
2 days ago
@l0b0 Exactly. Built-in utilities do not have any restrictions like that, andset
is furthermore a special built-in utility, which means it needs to always be built into the shell (or it would not be able to set positional parameters nor shell options).
– Kusalananda
2 days ago
I am getting this error. /bin/bash: /home/yogeshs/public_html/cleanup.sh: Permission denied i added sh file at public_html folder then added cron job (* * * * * /home/yogeshs/public_html/cleanup.sh )
– Yogesh Saroya
yesterday
@Kusalananda pls help getting Permission denied
– Yogesh Saroya
yesterday
@YogeshSaroya Either run the script withsh scriptname
or make it executable withchmod +x scriptname
and run it as you're trying to now.
– Kusalananda
yesterday
|
show 6 more comments
As long as your find
has an -mmin
option you can do:
Using a shell script:
#!/bin/sh
files_dir=/tmp
file_count=$(find "$files_dir" -name 'ci_session*' -mmin 60 -exec echo x ; | wc -l)
if [ "$file_count" -gt 1000 ]; then
find "$files_dir" -name 'ci_session*' -mmin 60 -exec rm {} ;
fi
file_count
will be set to the number of files found in the specified directory matching the pattern.
If file_count
is greater than 1000 we will run find again and delete those files.
Using bash we can eliminate the second call to find with an array:
#!/bin/bash
files_dir=/tmp
mapfile -t files < <(find "$files_dir" -name 'ci_session*' -mmin 60)
if ((${#files[@]}>1000)); then
rm "${files[@]}"
fi
Note: depending on how many files you expect to have the bash solution may run into your command line argument limit.
could you please update delete command to delete only 1hr older files ?
– Yogesh Saroya
2 days ago
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "106"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Yogesh Saroya is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f508198%2fremoving-files-under-particular-conditions-number-of-files-file-age%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
I interpreted your question as "How may I count the files, and if there are more than 1000, delete the ones that are older than one hour?".
Counting the names matching /tmp/ci_session*
and doing something when there's more than 1000 of them:
set -- /tmp/ci_session*
if [ "$#" -gt 1000 ]; then
# something
fi
This sets the positional parameters to the names matching the pattern. The special variable $#
then contains the number of positional parameters.
Deleting the files matching /tmp/ci_session*
if their last modified time is more than an hour ago:
find /tmp -maxdepth 1 -type f -name 'ci_session*' -mmin +60 -delete
Taken together:
#!/bin/sh
set -- /tmp/ci_session*
if [ "$#" -gt 1000 ]; then
find /tmp -maxdepth 1 -type f -name 'ci_session*' -mmin +60 -delete
fi
The only thing to note here is that the count will be of any name matching the pattern (even of directory names, if there are any), while the find
command will restrict the deletion to only regular files (i.e. not directories).
I thoughtset
would surely fail with "argument list too long" at some point, but no. I guess becauseset
is a built-in?
– l0b0
2 days ago
@l0b0 Exactly. Built-in utilities do not have any restrictions like that, andset
is furthermore a special built-in utility, which means it needs to always be built into the shell (or it would not be able to set positional parameters nor shell options).
– Kusalananda
2 days ago
I am getting this error. /bin/bash: /home/yogeshs/public_html/cleanup.sh: Permission denied i added sh file at public_html folder then added cron job (* * * * * /home/yogeshs/public_html/cleanup.sh )
– Yogesh Saroya
yesterday
@Kusalananda pls help getting Permission denied
– Yogesh Saroya
yesterday
@YogeshSaroya Either run the script withsh scriptname
or make it executable withchmod +x scriptname
and run it as you're trying to now.
– Kusalananda
yesterday
|
show 6 more comments
I interpreted your question as "How may I count the files, and if there are more than 1000, delete the ones that are older than one hour?".
Counting the names matching /tmp/ci_session*
and doing something when there's more than 1000 of them:
set -- /tmp/ci_session*
if [ "$#" -gt 1000 ]; then
# something
fi
This sets the positional parameters to the names matching the pattern. The special variable $#
then contains the number of positional parameters.
Deleting the files matching /tmp/ci_session*
if their last modified time is more than an hour ago:
find /tmp -maxdepth 1 -type f -name 'ci_session*' -mmin +60 -delete
Taken together:
#!/bin/sh
set -- /tmp/ci_session*
if [ "$#" -gt 1000 ]; then
find /tmp -maxdepth 1 -type f -name 'ci_session*' -mmin +60 -delete
fi
The only thing to note here is that the count will be of any name matching the pattern (even of directory names, if there are any), while the find
command will restrict the deletion to only regular files (i.e. not directories).
I thoughtset
would surely fail with "argument list too long" at some point, but no. I guess becauseset
is a built-in?
– l0b0
2 days ago
@l0b0 Exactly. Built-in utilities do not have any restrictions like that, andset
is furthermore a special built-in utility, which means it needs to always be built into the shell (or it would not be able to set positional parameters nor shell options).
– Kusalananda
2 days ago
I am getting this error. /bin/bash: /home/yogeshs/public_html/cleanup.sh: Permission denied i added sh file at public_html folder then added cron job (* * * * * /home/yogeshs/public_html/cleanup.sh )
– Yogesh Saroya
yesterday
@Kusalananda pls help getting Permission denied
– Yogesh Saroya
yesterday
@YogeshSaroya Either run the script withsh scriptname
or make it executable withchmod +x scriptname
and run it as you're trying to now.
– Kusalananda
yesterday
|
show 6 more comments
I interpreted your question as "How may I count the files, and if there are more than 1000, delete the ones that are older than one hour?".
Counting the names matching /tmp/ci_session*
and doing something when there's more than 1000 of them:
set -- /tmp/ci_session*
if [ "$#" -gt 1000 ]; then
# something
fi
This sets the positional parameters to the names matching the pattern. The special variable $#
then contains the number of positional parameters.
Deleting the files matching /tmp/ci_session*
if their last modified time is more than an hour ago:
find /tmp -maxdepth 1 -type f -name 'ci_session*' -mmin +60 -delete
Taken together:
#!/bin/sh
set -- /tmp/ci_session*
if [ "$#" -gt 1000 ]; then
find /tmp -maxdepth 1 -type f -name 'ci_session*' -mmin +60 -delete
fi
The only thing to note here is that the count will be of any name matching the pattern (even of directory names, if there are any), while the find
command will restrict the deletion to only regular files (i.e. not directories).
I interpreted your question as "How may I count the files, and if there are more than 1000, delete the ones that are older than one hour?".
Counting the names matching /tmp/ci_session*
and doing something when there's more than 1000 of them:
set -- /tmp/ci_session*
if [ "$#" -gt 1000 ]; then
# something
fi
This sets the positional parameters to the names matching the pattern. The special variable $#
then contains the number of positional parameters.
Deleting the files matching /tmp/ci_session*
if their last modified time is more than an hour ago:
find /tmp -maxdepth 1 -type f -name 'ci_session*' -mmin +60 -delete
Taken together:
#!/bin/sh
set -- /tmp/ci_session*
if [ "$#" -gt 1000 ]; then
find /tmp -maxdepth 1 -type f -name 'ci_session*' -mmin +60 -delete
fi
The only thing to note here is that the count will be of any name matching the pattern (even of directory names, if there are any), while the find
command will restrict the deletion to only regular files (i.e. not directories).
edited 2 days ago
answered 2 days ago
KusalanandaKusalananda
137k17258426
137k17258426
I thoughtset
would surely fail with "argument list too long" at some point, but no. I guess becauseset
is a built-in?
– l0b0
2 days ago
@l0b0 Exactly. Built-in utilities do not have any restrictions like that, andset
is furthermore a special built-in utility, which means it needs to always be built into the shell (or it would not be able to set positional parameters nor shell options).
– Kusalananda
2 days ago
I am getting this error. /bin/bash: /home/yogeshs/public_html/cleanup.sh: Permission denied i added sh file at public_html folder then added cron job (* * * * * /home/yogeshs/public_html/cleanup.sh )
– Yogesh Saroya
yesterday
@Kusalananda pls help getting Permission denied
– Yogesh Saroya
yesterday
@YogeshSaroya Either run the script withsh scriptname
or make it executable withchmod +x scriptname
and run it as you're trying to now.
– Kusalananda
yesterday
|
show 6 more comments
I thoughtset
would surely fail with "argument list too long" at some point, but no. I guess becauseset
is a built-in?
– l0b0
2 days ago
@l0b0 Exactly. Built-in utilities do not have any restrictions like that, andset
is furthermore a special built-in utility, which means it needs to always be built into the shell (or it would not be able to set positional parameters nor shell options).
– Kusalananda
2 days ago
I am getting this error. /bin/bash: /home/yogeshs/public_html/cleanup.sh: Permission denied i added sh file at public_html folder then added cron job (* * * * * /home/yogeshs/public_html/cleanup.sh )
– Yogesh Saroya
yesterday
@Kusalananda pls help getting Permission denied
– Yogesh Saroya
yesterday
@YogeshSaroya Either run the script withsh scriptname
or make it executable withchmod +x scriptname
and run it as you're trying to now.
– Kusalananda
yesterday
I thought
set
would surely fail with "argument list too long" at some point, but no. I guess because set
is a built-in?– l0b0
2 days ago
I thought
set
would surely fail with "argument list too long" at some point, but no. I guess because set
is a built-in?– l0b0
2 days ago
@l0b0 Exactly. Built-in utilities do not have any restrictions like that, and
set
is furthermore a special built-in utility, which means it needs to always be built into the shell (or it would not be able to set positional parameters nor shell options).– Kusalananda
2 days ago
@l0b0 Exactly. Built-in utilities do not have any restrictions like that, and
set
is furthermore a special built-in utility, which means it needs to always be built into the shell (or it would not be able to set positional parameters nor shell options).– Kusalananda
2 days ago
I am getting this error. /bin/bash: /home/yogeshs/public_html/cleanup.sh: Permission denied i added sh file at public_html folder then added cron job (* * * * * /home/yogeshs/public_html/cleanup.sh )
– Yogesh Saroya
yesterday
I am getting this error. /bin/bash: /home/yogeshs/public_html/cleanup.sh: Permission denied i added sh file at public_html folder then added cron job (* * * * * /home/yogeshs/public_html/cleanup.sh )
– Yogesh Saroya
yesterday
@Kusalananda pls help getting Permission denied
– Yogesh Saroya
yesterday
@Kusalananda pls help getting Permission denied
– Yogesh Saroya
yesterday
@YogeshSaroya Either run the script with
sh scriptname
or make it executable with chmod +x scriptname
and run it as you're trying to now.– Kusalananda
yesterday
@YogeshSaroya Either run the script with
sh scriptname
or make it executable with chmod +x scriptname
and run it as you're trying to now.– Kusalananda
yesterday
|
show 6 more comments
As long as your find
has an -mmin
option you can do:
Using a shell script:
#!/bin/sh
files_dir=/tmp
file_count=$(find "$files_dir" -name 'ci_session*' -mmin 60 -exec echo x ; | wc -l)
if [ "$file_count" -gt 1000 ]; then
find "$files_dir" -name 'ci_session*' -mmin 60 -exec rm {} ;
fi
file_count
will be set to the number of files found in the specified directory matching the pattern.
If file_count
is greater than 1000 we will run find again and delete those files.
Using bash we can eliminate the second call to find with an array:
#!/bin/bash
files_dir=/tmp
mapfile -t files < <(find "$files_dir" -name 'ci_session*' -mmin 60)
if ((${#files[@]}>1000)); then
rm "${files[@]}"
fi
Note: depending on how many files you expect to have the bash solution may run into your command line argument limit.
could you please update delete command to delete only 1hr older files ?
– Yogesh Saroya
2 days ago
add a comment |
As long as your find
has an -mmin
option you can do:
Using a shell script:
#!/bin/sh
files_dir=/tmp
file_count=$(find "$files_dir" -name 'ci_session*' -mmin 60 -exec echo x ; | wc -l)
if [ "$file_count" -gt 1000 ]; then
find "$files_dir" -name 'ci_session*' -mmin 60 -exec rm {} ;
fi
file_count
will be set to the number of files found in the specified directory matching the pattern.
If file_count
is greater than 1000 we will run find again and delete those files.
Using bash we can eliminate the second call to find with an array:
#!/bin/bash
files_dir=/tmp
mapfile -t files < <(find "$files_dir" -name 'ci_session*' -mmin 60)
if ((${#files[@]}>1000)); then
rm "${files[@]}"
fi
Note: depending on how many files you expect to have the bash solution may run into your command line argument limit.
could you please update delete command to delete only 1hr older files ?
– Yogesh Saroya
2 days ago
add a comment |
As long as your find
has an -mmin
option you can do:
Using a shell script:
#!/bin/sh
files_dir=/tmp
file_count=$(find "$files_dir" -name 'ci_session*' -mmin 60 -exec echo x ; | wc -l)
if [ "$file_count" -gt 1000 ]; then
find "$files_dir" -name 'ci_session*' -mmin 60 -exec rm {} ;
fi
file_count
will be set to the number of files found in the specified directory matching the pattern.
If file_count
is greater than 1000 we will run find again and delete those files.
Using bash we can eliminate the second call to find with an array:
#!/bin/bash
files_dir=/tmp
mapfile -t files < <(find "$files_dir" -name 'ci_session*' -mmin 60)
if ((${#files[@]}>1000)); then
rm "${files[@]}"
fi
Note: depending on how many files you expect to have the bash solution may run into your command line argument limit.
As long as your find
has an -mmin
option you can do:
Using a shell script:
#!/bin/sh
files_dir=/tmp
file_count=$(find "$files_dir" -name 'ci_session*' -mmin 60 -exec echo x ; | wc -l)
if [ "$file_count" -gt 1000 ]; then
find "$files_dir" -name 'ci_session*' -mmin 60 -exec rm {} ;
fi
file_count
will be set to the number of files found in the specified directory matching the pattern.
If file_count
is greater than 1000 we will run find again and delete those files.
Using bash we can eliminate the second call to find with an array:
#!/bin/bash
files_dir=/tmp
mapfile -t files < <(find "$files_dir" -name 'ci_session*' -mmin 60)
if ((${#files[@]}>1000)); then
rm "${files[@]}"
fi
Note: depending on how many files you expect to have the bash solution may run into your command line argument limit.
edited 2 days ago
answered 2 days ago
Jesse_bJesse_b
14k23572
14k23572
could you please update delete command to delete only 1hr older files ?
– Yogesh Saroya
2 days ago
add a comment |
could you please update delete command to delete only 1hr older files ?
– Yogesh Saroya
2 days ago
could you please update delete command to delete only 1hr older files ?
– Yogesh Saroya
2 days ago
could you please update delete command to delete only 1hr older files ?
– Yogesh Saroya
2 days ago
add a comment |
Yogesh Saroya is a new contributor. Be nice, and check out our Code of Conduct.
Yogesh Saroya is a new contributor. Be nice, and check out our Code of Conduct.
Yogesh Saroya is a new contributor. Be nice, and check out our Code of Conduct.
Yogesh Saroya is a new contributor. Be nice, and check out our Code of Conduct.
Thanks for contributing an answer to Unix & Linux Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f508198%2fremoving-files-under-particular-conditions-number-of-files-file-age%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
Why not parse
ls
?– Cyrus
2 days ago
Greater than 1000 what? Lines long? Bytes? Or are you wanting to delete only if there are more than 1000 files?
– Kusalananda
2 days ago
Are you okay with "Older than 1 hour" meaning last modified greater than 1 hour ago? Unix operating systems generally don't have a concept of creation time
– Jesse_b
2 days ago
@Kusalananda number of files.
– Yogesh Saroya
2 days ago